-- Logs begin at Thu 2022-07-14 10:14:12 UTC, end at Thu 2022-07-14 11:10:03 UTC. -- Jul 14 10:39:01.916960 dv-cinder-822821-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 10:39:01.925788 dv-cinder-822821-5-smb devstack@keystone.service[80157]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:39:01 2022] *** Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: nodename: dv-cinder-822821-5-smb Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: machine: x86_64 Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: clock source: unix Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: pcre jit disabled Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: detected number of CPU cores: 4 Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: current working directory: / Jul 14 10:39:01.927778 dv-cinder-822821-5-smb devstack@keystone.service[80157]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: your processes number limit is 47680 Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: your memory page size is 4096 bytes Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: detected max file descriptor number: 2048 Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: lock engine: pthread robust mutexes Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: thunder lock: enabled Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 10:39:01.928332 dv-cinder-822821-5-smb devstack@keystone.service[80157]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:39:01.973074 dv-cinder-822821-5-smb devstack@keystone.service[80157]: Python main interpreter initialized at 0x55ad000579c0 Jul 14 10:39:01.973074 dv-cinder-822821-5-smb devstack@keystone.service[80157]: python threads support enabled Jul 14 10:39:01.973074 dv-cinder-822821-5-smb devstack@keystone.service[80157]: your server socket listen backlog is limited to 100 connections Jul 14 10:39:01.973074 dv-cinder-822821-5-smb devstack@keystone.service[80157]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:39:01.973415 dv-cinder-822821-5-smb devstack@keystone.service[80157]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:39:01.973489 dv-cinder-822821-5-smb devstack@keystone.service[80157]: *** Operational MODE: preforking *** Jul 14 10:39:01.973760 dv-cinder-822821-5-smb devstack@keystone.service[80157]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:39:01.973760 dv-cinder-822821-5-smb devstack@keystone.service[80157]: spawned uWSGI master process (pid: 80157) Jul 14 10:39:01.973963 dv-cinder-822821-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 10:39:01.974984 dv-cinder-822821-5-smb devstack@keystone.service[80157]: spawned uWSGI worker 1 (pid: 80167, cores: 1) Jul 14 10:39:01.974984 dv-cinder-822821-5-smb devstack@keystone.service[80157]: spawned uWSGI worker 2 (pid: 80168, cores: 1) Jul 14 10:39:01.974984 dv-cinder-822821-5-smb devstack@keystone.service[80157]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:39:07.410774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:39:07.410774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: from cryptography.utils import int_from_bytes Jul 14 10:39:07.411583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:39:07.411583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: from cryptography.utils import int_from_bytes Jul 14 10:39:07.413059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:39:07.413059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: from cryptography.utils import int_from_bytes Jul 14 10:39:07.413518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:39:07.413518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: from cryptography.utils import int_from_bytes Jul 14 10:39:07.460132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:39:07.460333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:39:07.460527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] command line args: [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:39:07.460689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:39:07.460808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:39:07.460887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:39:07.460988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ================================================================================ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:39:07.461065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] command line args: [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:39:07.461250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] admin_token = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.461342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:39:07.461496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config_dir = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.461574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ================================================================================ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:39:07.461685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.461769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] admin_token = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.461867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] config_source = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config_dir = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] debug = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config_source = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] debug = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.462954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_config_append = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.463987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_dir = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_config_append = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_dir = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.464920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.465815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.466510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.466628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.466701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.466828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.466910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.466981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.467943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.468019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.468220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.468507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.468594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.468674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] publish_errors = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.468912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] publish_errors = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.469874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] standard_threads = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] standard_threads = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_journal = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.470952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_json = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_stderr = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_journal = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] use_syslog = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_json = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_stderr = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.471765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.471843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_syslog = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.472005 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.472105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:39:07.472302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.472383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.472542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.472625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.472800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.472944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.473980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.474942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.475996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.476994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.477960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.478918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.479985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.480960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.481041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.481192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.481277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.481421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.481606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.482989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.483935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.484892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.485966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.486886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.487883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.488848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.489956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.490912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.491957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.492953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.493979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.494900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.495990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.496995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.external = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.external = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.497998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.password = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] auth.token = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.password = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.498961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.token = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.499993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.500975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.501952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.502916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.503921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.504921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.505852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.506989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.507930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.508986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.509944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.510898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.511895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.512860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.513950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.514996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.515927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.516898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.517995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.518935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.519961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.520928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.521858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.522944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.523984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524702 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.524940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.525888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.526989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.527928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.528006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.528188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.528270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.528946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.529994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.530946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.531877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.532863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.533985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.534957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.535919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.536932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.537870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.538976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.539980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.540967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.541924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.542866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.543820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.544911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.545862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.546942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.547967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.548147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.548231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.548382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.548461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.548553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:39:07.548647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.548843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.549081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:39:07.549252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:39:07.579828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.580055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.580302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.580473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.580711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.580937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.588729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.589321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.617145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.617375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.617935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.618176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.759247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.759785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.808282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.808511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.809498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.809793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.875567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.875704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.875791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.875909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.876015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.877889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.902958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.903714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.914391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.915036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.927549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.927779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.927947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.928996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.929121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.929121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.929366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:39:07.946497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.946705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:39:07.947036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.947228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.947336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:39:07.947671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:39:07.947985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.948088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.948212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:39:07.948295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.948528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.948712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.948793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.948973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.949232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.949488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.959574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.959851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.960137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.960225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.960415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.960517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.960715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.960993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.969143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:07.969690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:07.972441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:07.972724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.972977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:07.973061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.973253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.973348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.973537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.973632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.973791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.973878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.974942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.975123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.975203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.975391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:07.975654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.001929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.002437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.003539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.003818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.004034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.004354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.009075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.009393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.009553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.009636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.009829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.010106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.017016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.017298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.017445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.017726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.021748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.022038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.022148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.022316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.022412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.022596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.022680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.022870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.022953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.023962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.042629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.042822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.042905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.043093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.048146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.048242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.051738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.051822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.052033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.052199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.057157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.057244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.060816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.060907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.064444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.064535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.064741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.064823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065867 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.065958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.084969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.085067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.085247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.085330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.085519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.085639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.085799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.085885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.094219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.094394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.095910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.096029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.096203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.096288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.099362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.099452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.099639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.099721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.099917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.100008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.100240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.100326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.100516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.100599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.113680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.113799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.113956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.114865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.115068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.115158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.115340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.115514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.134709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.134813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.138042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.138144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.141343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.141436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.142932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.143030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.144705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.144793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.144982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.145065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.145264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.145359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.152505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.152599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.154638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.154883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.157859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158681 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.158958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.167844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.168031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.168138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.168337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.168421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.168612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.176255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.176442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:39:08.176541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.176718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.176801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.176994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.177904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.178993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.179852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.180032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:39:08.218549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ad000579c0 pid: 80168 (default app) Jul 14 10:39:08.218652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ad000579c0 pid: 80167 (default app) Jul 14 10:39:08.221908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebb9e-0a40-4fa0-8e02-f94f1978f3a0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.222200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebb9e-0a40-4fa0-8e02-f94f1978f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.222487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebb9e-0a40-4fa0-8e02-f94f1978f3a0 None None] PATH_INFO: `/v3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.226685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:15.715359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.715922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.715922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.720248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:15.725441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.725861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.725987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.794373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: INFO dbcounter [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] Registered counter for database keystone Jul 14 10:39:15.815460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG oslo_db.sqlalchemy.engines [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:39:15.821625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writer thread running {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:39:15.997633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG passlib.handlers.bcrypt [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80168) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 10:39:15.997982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG passlib.handlers.bcrypt [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80168) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 10:39:16.051289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:16.052899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:16.171488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 10:39:16.237377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:16.307738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: INFO dbcounter [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] Registered counter for database keystone Jul 14 10:39:16.327979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG oslo_db.sqlalchemy.engines [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:39:16.334261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writer thread running {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:39:16.453387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25327566-59fd-486e-a98b-05d6525b5732 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.457702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.458362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.458647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.458926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.467560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.519264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 10:39:16.519608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0723a68-c066-4609-afbd-5380a373fcd7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.529102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 14 10:39:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:39:16.535187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:16.549541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91493d-1a10-4048-8939-596421f46fe9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.554630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.555757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.556044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.556355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] PATH_INFO: `/v3/projects/2dceb4db085a4305881c3af4908bb6f8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.561013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] RBAC: Authorizing `identity:get_project(project_id=2dceb4db085a4305881c3af4908bb6f8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.611688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 10:39:16.612035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cefda-4451-4597-ba44-586c447732bd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.616666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Jul 14 10:39:16 2022] GET /identity/v3/projects/2dceb4db085a4305881c3af4908bb6f8 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:18.583250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cbee-060e-4ade-930f-de15a7e76287 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.583787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cbee-060e-4ade-930f-de15a7e76287 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.583787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cbee-060e-4ade-930f-de15a7e76287 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.587867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:18.593729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.594158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.594294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.613330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:18.614854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:18.622739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 10:39:18.643944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cbee-060e-4ade-930f-de15a7e76287 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.656342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cbee-060e-4ade-930f-de15a7e76287 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.660526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ebf1-2306-4583-88af-925bcdb07104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.661146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ebf1-2306-4583-88af-925bcdb07104 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.661427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ebf1-2306-4583-88af-925bcdb07104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.661699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ebf1-2306-4583-88af-925bcdb07104 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.669325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ebf1-2306-4583-88af-925bcdb07104 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.671066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ebf1-2306-4583-88af-925bcdb07104 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.679682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:39:18.685220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.694154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767c8fc-9f29-424e-bc08-49b473d971f3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.698792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e895-bfe0-46a4-94b5-ec70d6e6ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.699639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e895-bfe0-46a4-94b5-ec70d6e6ce00 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.699923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e895-bfe0-46a4-94b5-ec70d6e6ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.700267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e895-bfe0-46a4-94b5-ec70d6e6ce00 admin admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.701656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e895-bfe0-46a4-94b5-ec70d6e6ce00 admin admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.703458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e895-bfe0-46a4-94b5-ec70d6e6ce00 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.705043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:20.781370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c56ba-3600-485c-ac0a-01e8d2b5f6dd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.781900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c56ba-3600-485c-ac0a-01e8d2b5f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.781988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c56ba-3600-485c-ac0a-01e8d2b5f6dd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.783279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:20.788565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.788952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.789126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.806096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:20.807431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:20.819416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acfc5d-ecfc-4882-9e37-f17b91b1949d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.819704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acfc5d-ecfc-4882-9e37-f17b91b1949d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.819986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acfc5d-ecfc-4882-9e37-f17b91b1949d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.821354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:20.826616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.826902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.827191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.867242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG passlib.handlers.bcrypt [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80167) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 10:39:20.867670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG passlib.handlers.bcrypt [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80167) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 10:39:20.891247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:20.913434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:20.913641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:20.915263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:20.936929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.015789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:21.026935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4367455-4f39-4709-8c2b-9049472fda08 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.038070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.062197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.062994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.063285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.063568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.075580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:21.086876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:21.087872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:21.088700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:21.094808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.134781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2815f41-ab31-43f0-a307-b1e9743f4baf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.137296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.172651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.173551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.173843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.174134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.175270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.193166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1078e-1977-43c4-989e-5a7f0d2e6e34 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.226667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c439021-d993-4890-8185-14c34da86623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.227328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c439021-d993-4890-8185-14c34da86623 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.227619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c439021-d993-4890-8185-14c34da86623 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.227901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c439021-d993-4890-8185-14c34da86623 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.228686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c439021-d993-4890-8185-14c34da86623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:21.228999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c439021-d993-4890-8185-14c34da86623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.230396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c439021-d993-4890-8185-14c34da86623 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.240701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.242207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.242470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.248001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c439021-d993-4890-8185-14c34da86623 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.338284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:21.343971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.347433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.349908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c439021-d993-4890-8185-14c34da86623 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.383881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.384787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.385065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.385345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.386536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.388005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.389840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:21.395007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.408777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.451338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbf5ce-ce5e-4c49-9707-7843e3428a50 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.485856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.486656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.486945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.487226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.494352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea8de5-d4ad-4f75-ad2d-eee9870331f6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.505764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.507229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:21.527981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:21.528859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:21.529802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:21.529802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:21.529802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:21.529802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:21.530016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.530101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:21.530163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.530163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.530163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.531214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.532720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.534304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:21.535785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.539776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.593227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.618891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.635684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7f71-9738-4d1d-887d-7b64138e8f4b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.637995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b94454-9550-4ef0-b83f-a71daee617f7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.670791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.671179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.671474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.673090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.673825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:21.674134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.675523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb8a5-ef4c-4a20-92cd-6eea923a73fe None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.677503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.678548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.678957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.679324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.680556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.domain.id=default, user.id=6dda363092bb44769e4fcafaa65574cd) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:21.680876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.682314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e5498-cd73-4618-a16e-a098db0e654d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.689510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/role_assignments?user.id=6dda363092bb44769e4fcafaa65574cd&scope.domain.id=default&role.id=195f05d542f14d7b93230878b428d9eb => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.693261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:23.872888 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b836-dd0a-4952-b048-790ed86dbf66 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.873345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b836-dd0a-4952-b048-790ed86dbf66 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.873441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b836-dd0a-4952-b048-790ed86dbf66 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.874807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:23.880372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.881184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.881659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.905068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:23.906604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:23.993437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:24.033560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1b836-dd0a-4952-b048-790ed86dbf66 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.168889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1b836-dd0a-4952-b048-790ed86dbf66 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.210824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d444-b6f7-4186-b277-1f8c5d70108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.211987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d444-b6f7-4186-b277-1f8c5d70108b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.212512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d444-b6f7-4186-b277-1f8c5d70108b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.212990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d444-b6f7-4186-b277-1f8c5d70108b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.230830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d444-b6f7-4186-b277-1f8c5d70108b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e550d444-b6f7-4186-b277-1f8c5d70108b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:24.239298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:24.240144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:24.240902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:24.243202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 13/24] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:24.249255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.313211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.369953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ae2f-e67d-42c2-9557-829b6e1ba664 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.370604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ae2f-e67d-42c2-9557-829b6e1ba664 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.371082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ae2f-e67d-42c2-9557-829b6e1ba664 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.373339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 14/25] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:24.380538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ca31-d34d-4a07-b4fb-83cd29b2f0fc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.381078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ca31-d34d-4a07-b4fb-83cd29b2f0fc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.381571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ca31-d34d-4a07-b4fb-83cd29b2f0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.385148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2452b-bf0d-4669-9292-51825964ac71 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.393188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.413142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2f00ca31-d34d-4a07-b4fb-83cd29b2f0fc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:24.414699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2f00ca31-d34d-4a07-b4fb-83cd29b2f0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:24.440411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.441017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.441305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.441583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.442346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:24.442665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:24.444077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:24.464845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 12/26] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:24.470856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.585417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 15/27] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:24.586791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e629d27-488f-4930-b43a-ff8101627d2e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.587082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e629d27-488f-4930-b43a-ff8101627d2e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.587360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e629d27-488f-4930-b43a-ff8101627d2e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.588661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 16/28] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:24.594815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.595105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.595389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.624096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:24.624096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:24.666177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b31d2-6695-43b6-9e60-9817adff0d74 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.688399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.724543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156d0c-49fe-45f8-b87f-5167feaf7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.724743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 17/29] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:24.725413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.725911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156d0c-49fe-45f8-b87f-5167feaf7c39 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.726351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156d0c-49fe-45f8-b87f-5167feaf7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.726825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156d0c-49fe-45f8-b87f-5167feaf7c39 None admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.728607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75156d0c-49fe-45f8-b87f-5167feaf7c39 None admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:24.730236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75156d0c-49fe-45f8-b87f-5167feaf7c39 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:24.732704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 13/30] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:24.734050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5c92-8ac6-4e89-a974-fcea90048507 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.734645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5c92-8ac6-4e89-a974-fcea90048507 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.735059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa5c92-8ac6-4e89-a974-fcea90048507 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.737301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 14/31] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:24.747347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5c92-8ac6-4e89-a974-fcea90048507 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.809302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.850401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f128c52-563d-4337-b248-a08d52bff143 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.861531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa5c92-8ac6-4e89-a974-fcea90048507 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.888156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.889004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.889291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.889567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.900895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:24.902546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:24.902977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ef00e-6d04-4564-833f-ee7148e3ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.903933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef00e-6d04-4564-833f-ee7148e3ac05 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.904348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef00e-6d04-4564-833f-ee7148e3ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.904716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef00e-6d04-4564-833f-ee7148e3ac05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.906011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ef00e-6d04-4564-833f-ee7148e3ac05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:24.907536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ef00e-6d04-4564-833f-ee7148e3ac05 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:24.909442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 15/32] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:24.915046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.915435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.915815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:24.926762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:24.927771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:24.928818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:24.928818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:24.928818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:24.928818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:24.930857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 18/33] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:24.931876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.935786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:24.937095 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:24.979331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.007653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 16/34] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:25.016122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.070502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f98f-27e1-4c9d-a9ed-47f19bbdebfc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.088763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.110173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.110843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.111133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.111419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.112223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.113890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.116448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3243f-9f1d-4134-b9e4-4c91b9f707be None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.153817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.155152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.155631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.156159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] PATH_INFO: `/v3/domains/default/users/6dda363092bb44769e4fcafaa65574cd/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.158385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6dda363092bb44769e4fcafaa65574cd, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.160053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.252247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 19/35] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 14 10:39:24 2022] POST /identity/v3/roles => generated 219 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:25.252247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.308316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 17/36] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Jul 14 10:39:25 2022] PUT /identity/v3/domains/default/users/6dda363092bb44769e4fcafaa65574cd/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:25.309930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.382083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.410249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8d0b5-2346-4a6c-8a4b-c23d25e38e1d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.479155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.479906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.480258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.480558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.481369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:25.481687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.483262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.513858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 20/37] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:25.519833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.562518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.566685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f32c1-9d5c-4fe2-a140-ff6d2e272004 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.605774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbced0-c60f-40c5-8b4d-7aa7c40a1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.607097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbced0-c60f-40c5-8b4d-7aa7c40a1d5c None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.607411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbced0-c60f-40c5-8b4d-7aa7c40a1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.607770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbced0-c60f-40c5-8b4d-7aa7c40a1d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.610385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbced0-c60f-40c5-8b4d-7aa7c40a1d5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.612015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbced0-c60f-40c5-8b4d-7aa7c40a1d5c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.640357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 18/38] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/roles => generated 225 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:25.641761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bf12f-61c2-4755-bc7d-ea1ddad24662 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.642051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bf12f-61c2-4755-bc7d-ea1ddad24662 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.642332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bf12f-61c2-4755-bc7d-ea1ddad24662 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.643627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 19/39] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:25.644812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6245-2862-42db-a743-ee734a70a7bc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.645096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6245-2862-42db-a743-ee734a70a7bc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.645479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f6245-2862-42db-a743-ee734a70a7bc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.646959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 20/40] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:25.650300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b002343-6876-404d-97fd-eafcdd091171 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.650433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a36685-5dc3-4e77-adc7-35a2d3abcafe None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.650668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a36685-5dc3-4e77-adc7-35a2d3abcafe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.651121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a36685-5dc3-4e77-adc7-35a2d3abcafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.671541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-04a36685-5dc3-4e77-adc7-35a2d3abcafe None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:25.673452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-04a36685-5dc3-4e77-adc7-35a2d3abcafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:25.769390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:25.772560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.772885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.773171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.792828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:25.794115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:25.818853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.823770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.824597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.825533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.825785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.826759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.828299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.861480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/projects => generated 301 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:25.862299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.890918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 22/43] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:25.908056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.999358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:26.018602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6a18f-8b89-434e-980f-f5979c342750 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.035789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b3b74-ea75-45ef-957e-627edf2d76e0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.069258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.070086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.070375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.070652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.071945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.073737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.075576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 22/44] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:26.081542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:26.182356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b760-751e-48b9-8494-c341b5f34aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.183034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b760-751e-48b9-8494-c341b5f34aa6 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.183323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b760-751e-48b9-8494-c341b5f34aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.183603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b760-751e-48b9-8494-c341b5f34aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.184919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84b760-751e-48b9-8494-c341b5f34aa6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.186313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84b760-751e-48b9-8494-c341b5f34aa6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.199388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dbb74-aa4a-4ca4-9275-7c964b2c9309 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.212092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:39:26.237877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571b043-ef1f-4f09-adac-16e10a3248b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.238661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b043-ef1f-4f09-adac-16e10a3248b3 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.239014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b043-ef1f-4f09-adac-16e10a3248b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.239357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b043-ef1f-4f09-adac-16e10a3248b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.240245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b043-ef1f-4f09-adac-16e10a3248b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.241854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b043-ef1f-4f09-adac-16e10a3248b3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.273997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:39:26 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:39:27.579996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b981-5aad-408f-834f-5180b58d17ee None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.580527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b981-5aad-408f-834f-5180b58d17ee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.580609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32b981-5aad-408f-834f-5180b58d17ee None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.582185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:27.587497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.587912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.588055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.604755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:27.606446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:27.608392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:27.674186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:27.696497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32b981-5aad-408f-834f-5180b58d17ee None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.712606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:27.798195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32b981-5aad-408f-834f-5180b58d17ee None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:27.831342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:27.832114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.832406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.832685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.844248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:27.853216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:27.854048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:27.854840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:27.860366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.961171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12ac4b-a440-49d2-aad8-13e49fab1434 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:27.994887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:27.995558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.995848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.996164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.996962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:27.997279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:27.998675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.003729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.007424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 25/50] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:28.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.088872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.115184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113fce-a9a6-439f-9138-b986f54fd873 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.148544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.149424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.149712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.149995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.151203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.152714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.154962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:28.160392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.260117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043f5db-4a9b-497f-92b3-35461cc84d3f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.294324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164c4c-24f5-4320-a9e4-48de529634d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.295114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164c4c-24f5-4320-a9e4-48de529634d1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.295399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164c4c-24f5-4320-a9e4-48de529634d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.295676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164c4c-24f5-4320-a9e4-48de529634d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.296870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9164c4c-24f5-4320-a9e4-48de529634d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.298310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9164c4c-24f5-4320-a9e4-48de529634d1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.299924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 26/52] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:28.305594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.398166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748af6-77e6-4d08-a2b3-0237907a46f7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.398379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748af6-77e6-4d08-a2b3-0237907a46f7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.398679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748af6-77e6-4d08-a2b3-0237907a46f7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.400053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 27/53] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:28.404851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.405144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.405429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.407256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a3a63-d05e-482f-ba7d-896289368ed7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.421537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:28.422732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:28.441405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.442065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.442357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.442643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.443484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.domain.id=default, user.id=6dda363092bb44769e4fcafaa65574cd) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:28.443801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.445301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.454054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 27/54] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/role_assignments?user.id=6dda363092bb44769e4fcafaa65574cd&scope.domain.id=default&role.id=195f05d542f14d7b93230878b428d9eb => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:28.487581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.493975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 28/55] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:28.518219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.528380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.628361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa211-5f45-49be-92d2-6467242c0734 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.662189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcaf74-7a14-4445-b076-760f366f3241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.662990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcaf74-7a14-4445-b076-760f366f3241 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.663275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcaf74-7a14-4445-b076-760f366f3241 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.663556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcaf74-7a14-4445-b076-760f366f3241 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.664768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcaf74-7a14-4445-b076-760f366f3241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.666211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcaf74-7a14-4445-b076-760f366f3241 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.667841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 28/56] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:28.674190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.769226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4c20-34e1-4ffb-8043-513226167539 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.801359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a529228-7b41-472a-8fa9-fdb01d5dae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.802001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a529228-7b41-472a-8fa9-fdb01d5dae52 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.802284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a529228-7b41-472a-8fa9-fdb01d5dae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.802560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a529228-7b41-472a-8fa9-fdb01d5dae52 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.803267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a529228-7b41-472a-8fa9-fdb01d5dae52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.804729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a529228-7b41-472a-8fa9-fdb01d5dae52 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.829430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 29/57] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 14 10:39:28 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:30.880881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbdf63-305b-4f8a-bbfc-0d0cefc0dd30 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:30.881272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbdf63-305b-4f8a-bbfc-0d0cefc0dd30 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:30.881448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbdf63-305b-4f8a-bbfc-0d0cefc0dd30 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:30.882834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 29/58] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:30.887926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:30.888357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:30.888518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:30.904886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:30.906071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:30.951068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:30.971651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:30.996190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbdf63-305b-4f8a-bbfc-0d0cefc0dd30 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.069579 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.094437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbdf63-305b-4f8a-bbfc-0d0cefc0dd30 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.127558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5cde9-0fa1-465e-85a5-3ec868de7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.128305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cde9-0fa1-465e-85a5-3ec868de7625 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.128592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cde9-0fa1-465e-85a5-3ec868de7625 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.128869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cde9-0fa1-465e-85a5-3ec868de7625 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.130042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5cde9-0fa1-465e-85a5-3ec868de7625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.131500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5cde9-0fa1-465e-85a5-3ec868de7625 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.133128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 30/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:31.138653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.237982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dfb7b-4d30-4e16-a324-2b476fe9fb84 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.270218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5c56a-114d-460b-851a-6ae17a0eebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.270882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c56a-114d-460b-851a-6ae17a0eebce None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.271169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c56a-114d-460b-851a-6ae17a0eebce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.271449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c56a-114d-460b-851a-6ae17a0eebce None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.272200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c56a-114d-460b-851a-6ae17a0eebce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.273643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c56a-114d-460b-851a-6ae17a0eebce None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.298945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 31/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:31 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:34.312845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77490730-7ec3-4c58-b9f3-aef082cc3397 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.315355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77490730-7ec3-4c58-b9f3-aef082cc3397 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.315355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77490730-7ec3-4c58-b9f3-aef082cc3397 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.315355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 31/62] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:34.320799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.321541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.321962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.349150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:34.350622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:34.387738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.441741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 32/63] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:34.477055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77490730-7ec3-4c58-b9f3-aef082cc3397 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.613081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77490730-7ec3-4c58-b9f3-aef082cc3397 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.661636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fee102-2b2d-4631-866b-0fdf31834e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.662444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fee102-2b2d-4631-866b-0fdf31834e7d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.662732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fee102-2b2d-4631-866b-0fdf31834e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.663013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fee102-2b2d-4631-866b-0fdf31834e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.674636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fee102-2b2d-4631-866b-0fdf31834e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-68fee102-2b2d-4631-866b-0fdf31834e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:34.682965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:34.683795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:34.684640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:34.686965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 32/64] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:34.692866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.725767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3887-2d6a-4d3b-9950-c3be7a67cc79 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.726390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3887-2d6a-4d3b-9950-c3be7a67cc79 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.727135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb3887-2d6a-4d3b-9950-c3be7a67cc79 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.728772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 33/65] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:34.734813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b995-0156-4a00-b56d-419531465467 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.735368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b995-0156-4a00-b56d-419531465467 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.735870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b995-0156-4a00-b56d-419531465467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.750538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.770371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-08d4b995-0156-4a00-b56d-419531465467 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:34.771595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-08d4b995-0156-4a00-b56d-419531465467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:34.880102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1626-daca-4df7-85c5-f3c7364d798b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.884387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 34/66] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:34.885977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db445a-d7ea-4ff1-89d8-59f852c2b890 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.886469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db445a-d7ea-4ff1-89d8-59f852c2b890 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.886943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db445a-d7ea-4ff1-89d8-59f852c2b890 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.889221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 35/67] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:34.896833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0f24f-fc1a-4a19-a7a7-f69332c396f9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.897402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0f24f-fc1a-4a19-a7a7-f69332c396f9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.897880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0f24f-fc1a-4a19-a7a7-f69332c396f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.918108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e2f0f24f-fc1a-4a19-a7a7-f69332c396f9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:34.920356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e2f0f24f-fc1a-4a19-a7a7-f69332c396f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:34.927682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.928466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.928677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.928957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.929714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:34.930025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.931413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140788-b6c9-45eb-bce3-c9d9a125e5a1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.940492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 33/68] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:34.941746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347252c-0f1b-43d8-99a0-c6fb85c20a9f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.942039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347252c-0f1b-43d8-99a0-c6fb85c20a9f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.942312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347252c-0f1b-43d8-99a0-c6fb85c20a9f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.943699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 34/69] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:34.944253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347252c-0f1b-43d8-99a0-c6fb85c20a9f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.973316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.991436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 36/70] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:34.992953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ceaf8-8b92-4be6-b306-77ccdc94026e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.993432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ceaf8-8b92-4be6-b306-77ccdc94026e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.993562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ceaf8-8b92-4be6-b306-77ccdc94026e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.994919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 37/71] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:34.995473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ceaf8-8b92-4be6-b306-77ccdc94026e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.051073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347252c-0f1b-43d8-99a0-c6fb85c20a9f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.061099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.086306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8f06f-30e3-4ea7-b46d-9237b039dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.087127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8f06f-30e3-4ea7-b46d-9237b039dba4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.087419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8f06f-30e3-4ea7-b46d-9237b039dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.087704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8f06f-30e3-4ea7-b46d-9237b039dba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.098561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8f06f-30e3-4ea7-b46d-9237b039dba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:35.101278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ceaf8-8b92-4be6-b306-77ccdc94026e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d8d8f06f-30e3-4ea7-b46d-9237b039dba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:35.106351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:35.107178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:35.107938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:35.112198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 35/72] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:35.113684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.113984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.114277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.130763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:35.131915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:35.134602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10300ef1-ccf6-40f1-a37f-5c2c8f077f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.135476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10300ef1-ccf6-40f1-a37f-5c2c8f077f24 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.135761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10300ef1-ccf6-40f1-a37f-5c2c8f077f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.136040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10300ef1-ccf6-40f1-a37f-5c2c8f077f24 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.150550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10300ef1-ccf6-40f1-a37f-5c2c8f077f24 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.152010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10300ef1-ccf6-40f1-a37f-5c2c8f077f24 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.154239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 38/73] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.155409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.155722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.156001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.171901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:35.173129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:35.201636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 36/74] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:35.204991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.223664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.240154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 39/75] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:35.241006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.289958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.304529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a36f-07f6-44ff-808d-72df9a56b201 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.339094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.339891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.340238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.340521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.341124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4356-d313-4b35-b761-2aba0d0ae68c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.350595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:35.358827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:35.359685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:35.360754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 37/76] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:35.361374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.379067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.379740 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.380026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.380340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.381147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:35.381413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.382797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.390902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 40/77] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.391694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.440352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.461759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c83dec-a51c-4235-9046-7f5d658ec42a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.489375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd968e74-73d1-43d3-929a-b2596c40d4cc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.494519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.495174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.495464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.495749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.502034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.522963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437113f-dcc2-4139-9205-430589124074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.523769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437113f-dcc2-4139-9205-430589124074 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.524053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437113f-dcc2-4139-9205-430589124074 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.524358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437113f-dcc2-4139-9205-430589124074 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.534918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437113f-dcc2-4139-9205-430589124074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3437113f-dcc2-4139-9205-430589124074 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:35.542989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:35.543907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:35.544745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 41/78] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:35.545355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437113f-dcc2-4139-9205-430589124074 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.569012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.571833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.642955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437113f-dcc2-4139-9205-430589124074 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.653964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.676444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.681034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 38/79] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:35.681153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.681153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.681153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.681353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.681417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.681417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.686305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 42/80] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.686305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.725420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.780599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d60eb8-e5f4-42b6-a551-cacaf2502004 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.780757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc58b1f-6951-4f04-8c34-a4454d65d287 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.813926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.814759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.814880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.815061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.815336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.815445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.815693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.815975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.816542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.816744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:35.817053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.817981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.818415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.819599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 43/81] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.820374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.831654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 39/82] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.835643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.878961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.920108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76f576-4c37-4512-9507-162e4ee2f55c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.929157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.937953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9757270-9138-47da-88e9-37c83e1496ea None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.954376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.955045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.955330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.955610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.956399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:35.956734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.958125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.966270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 44/83] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.967030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.971140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.972092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.972446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.972730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.973937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.975381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.977120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 40/84] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.977885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.063826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cae1b-4aba-4031-84df-3da2dd761faf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.076158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3991f9f-d3ac-4a90-a66b-904d06c47d0d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.084640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.096930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.097599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.097889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.098175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.098898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.102386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.111101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.111740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.112030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.112334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.128866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 45/85] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:35 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:36.129691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.167781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.191311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.192976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.254760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177e76-fa0a-4757-b550-f5c4906b1281 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.292689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.294123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.294390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.294664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.296182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.297638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.299325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 46/86] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.300038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.311112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 41/87] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:36.311973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.325889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.419982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.427713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b73e07-52a8-4800-9b86-a0608c43d795 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.435488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0a77c-5b28-4995-bc1b-89d6f527b4dc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.467825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.468703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.468996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.469382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.470660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.472176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.473834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 47/88] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.474606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.475353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.476024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.476343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.476624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.477609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=06de9042d4e14337bcd1d47f0275b9ee) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:36.478090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.479679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.485727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 42/89] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/role_assignments?user.id=06de9042d4e14337bcd1d47f0275b9ee&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.488940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.640847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.682141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398675-cf05-4811-b01c-70ce67597858 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.695849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41dc5f-5344-4229-a630-02413e01801c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.741028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.741713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.742010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.742296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.746877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.747957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.749465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.749960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.757140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.758882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.760847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 43/90] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.761813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.800275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.850864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.851649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.962941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cade-b43c-4391-a763-d19c427c2a00 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.026483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 48/91] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:37.027273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.030882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.031388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.031837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.032129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.054568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.129634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.157625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.159087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.217472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa6c0-e285-49b0-86ee-2be32ed10227 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.256360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.257017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.257307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.257584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.258418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=6dda363092bb44769e4fcafaa65574cd) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:37.258730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.260185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.265999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 49/92] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/role_assignments?user.id=6dda363092bb44769e4fcafaa65574cd&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:37.266798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.310071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 44/93] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:37.315892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.362614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.380135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0cecc-7c7c-4614-8f35-fa86e6ff6c8d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.409309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.418736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.419614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.419895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.420215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] PATH_INFO: `/v3/projects/e12734cdeb064a48b515fb538241bf59` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.421611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] RBAC: Authorizing `identity:get_project(project_id=e12734cdeb064a48b515fb538241bf59)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.423268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.425637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 50/94] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/projects/e12734cdeb064a48b515fb538241bf59 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:37.431417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.431731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a68f-9f4f-47f9-b120-46821fc97fef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.470656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.472241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.472686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.473118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.474470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.476194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.478432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 45/95] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:37.484501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.540921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cafaf-dc49-4782-acdc-74daf743cc2e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.578588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.579461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.579901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.580356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.581340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=e12734cdeb064a48b515fb538241bf59, user.id=06de9042d4e14337bcd1d47f0275b9ee) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:37.581795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.583382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4118-c241-42ed-ba60-4de5b817751e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.590041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 51/96] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/role_assignments?user.id=06de9042d4e14337bcd1d47f0275b9ee&scope.project.id=e12734cdeb064a48b515fb538241bf59&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:37.633576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9015-e24a-46e9-9f95-5eff67d6f8d3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.644562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.671976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.672680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.672964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.673237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.674081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] RBAC: Adding query filter params (role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=06de9042d4e14337bcd1d47f0275b9ee) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:37.674393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.675868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2715-80ec-452f-ad83-af7b0e641967 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.682763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 46/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/role_assignments?user.id=06de9042d4e14337bcd1d47f0275b9ee&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:38.804461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476da75-74cc-4d3b-94d4-6185814375d9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.804990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476da75-74cc-4d3b-94d4-6185814375d9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.805065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476da75-74cc-4d3b-94d4-6185814375d9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.806445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 52/98] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:38.812083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75394de-3fdb-48e5-86e3-29e988b723c0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.812884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75394de-3fdb-48e5-86e3-29e988b723c0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.813378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75394de-3fdb-48e5-86e3-29e988b723c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.837073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b75394de-3fdb-48e5-86e3-29e988b723c0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:38.838842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b75394de-3fdb-48e5-86e3-29e988b723c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:38.933311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 47/99] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:38.956293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4c37e-5fb0-43f3-88ba-a58e2bacb5b1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.956573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4c37e-5fb0-43f3-88ba-a58e2bacb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.956851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4c37e-5fb0-43f3-88ba-a58e2bacb5b1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.958220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 53/100] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:38.963307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.963601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.963882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.966886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4c37e-5fb0-43f3-88ba-a58e2bacb5b1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.008932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:39.010140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:39.078021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.127074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4c37e-5fb0-43f3-88ba-a58e2bacb5b1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.163042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.163844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.164155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.164436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.173578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 48/101] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:39.175771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:39.183825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:39.184846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:39.185783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:39.187975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 54/102] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:39.195945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.206108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.294539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.312458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceb542-b983-4172-bcf5-cff0053367a7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.348468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.368999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd265-4e98-4319-a7f4-fab185d37a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.369795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd265-4e98-4319-a7f4-fab185d37a4f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.370080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd265-4e98-4319-a7f4-fab185d37a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.370358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd265-4e98-4319-a7f4-fab185d37a4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.371607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd265-4e98-4319-a7f4-fab185d37a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.374388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd265-4e98-4319-a7f4-fab185d37a4f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.376010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 55/103] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:39.377349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b366-8cbb-4621-b152-afe2dc079b3b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.377642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b366-8cbb-4621-b152-afe2dc079b3b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.377933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8b366-8cbb-4621-b152-afe2dc079b3b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.379152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 56/104] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:39.384053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b366-8cbb-4621-b152-afe2dc079b3b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.442180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee375bf-da12-448f-97c9-0b4a982acc56 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.489111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8b366-8cbb-4621-b152-afe2dc079b3b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.525046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.525768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.526054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.526335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.527136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.529196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.532756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.533437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.533719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.533994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.534758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:39.535067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.536454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a94ad9-bca0-45f9-997e-d7c6a68c4ebe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.552460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 49/105] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:39.560617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.561388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.562440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.564692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 57/106] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:39:39 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:39.567174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.600828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:39.605387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:39.665759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.737982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36597e59-e3ff-4589-ba84-6ca3db02358a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.740389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 50/107] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:39.776987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.778419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.778702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.778978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] PATH_INFO: `/v3/users/827e6785bc5c4d529c096df67585bf2f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.781158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.794833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] RBAC: Authorizing `identity:get_user(user_id=827e6785bc5c4d529c096df67585bf2f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.796498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.798282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 58/108] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/users/827e6785bc5c4d529c096df67585bf2f => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:39.804292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.821896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.912963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.919617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef85a-9ea7-44f0-a83e-7c9c2b356c0c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.944426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b47e4c-7cf2-4636-b096-a608f532b55c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.958217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.958925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.959218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.959500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.982719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.983525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.983917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.984225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.995260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:40.004022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:40.004890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:40.005654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 51/109] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:40.012653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.033930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.035477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.107385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.131737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de997-50c1-4e7e-b825-07406193acf6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.140440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.145550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 59/110] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:40.151130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.195184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.195906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.196287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.196574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.197346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:40.198015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.199943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.217825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 52/111] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:40.223609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.257088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb76dc2-66a7-4b27-a01f-c34b1ba41bb1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.292645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.293626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.293962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.294250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.297642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.299106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.304390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 60/112] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:40.315529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.410695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.446160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09daa6-dbc4-4a9b-a83e-b664baffe68e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.450076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01d743-d2a8-41ea-8ea6-4448f384783f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.514044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d26ddb-4ce2-42eb-9101-37b43c90d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.515293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26ddb-4ce2-42eb-9101-37b43c90d904 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.515581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26ddb-4ce2-42eb-9101-37b43c90d904 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.515857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d26ddb-4ce2-42eb-9101-37b43c90d904 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.517893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.518546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.518881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.519206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.520125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] RBAC: Adding query filter params (role.id=ce5ed55c56cd47568cf0cbe03f23d08e, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=827e6785bc5c4d529c096df67585bf2f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:40.520445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.521898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c322-a97e-4c12-a94a-b408b8991d57 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.524051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d26ddb-4ce2-42eb-9101-37b43c90d904 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.525504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d26ddb-4ce2-42eb-9101-37b43c90d904 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.528074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 53/113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:40.530404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500073-f9da-437c-b777-6d5f851e5a8d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.530691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500073-f9da-437c-b777-6d5f851e5a8d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.530972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500073-f9da-437c-b777-6d5f851e5a8d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.532293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 54/114] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:40.535490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 61/115] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/role_assignments?user.id=827e6785bc5c4d529c096df67585bf2f&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=ce5ed55c56cd47568cf0cbe03f23d08e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:40.541487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500073-f9da-437c-b777-6d5f851e5a8d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.542367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b3999-b717-4cd7-91b3-58c88cd00d31 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.542862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b3999-b717-4cd7-91b3-58c88cd00d31 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.543435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b3999-b717-4cd7-91b3-58c88cd00d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.560592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.577653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-808b3999-b717-4cd7-91b3-58c88cd00d31 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:40.578901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-808b3999-b717-4cd7-91b3-58c88cd00d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:40.662454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500073-f9da-437c-b777-6d5f851e5a8d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.678220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 62/116] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:40.679568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a0a3a-6b50-465a-b3ef-04e92245c1c3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.679859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a0a3a-6b50-465a-b3ef-04e92245c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.680164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a0a3a-6b50-465a-b3ef-04e92245c1c3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.681559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 63/117] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:40.686710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.687002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.687284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.708348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:40.710108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:40.722175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.723155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.723442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.723719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.726338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.727951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.731657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 55/118] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:40.737340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.778573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.798467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 64/119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:40.799434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.847480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.869661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa6ab4-557a-425b-be94-f52779c8399d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.923122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6af0aa-4041-434b-be1d-71f3a3b531b4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.940338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.941147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.941429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.948084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.970430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:40.972421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.973364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.973642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.973914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/06de9042d4e14337bcd1d47f0275b9ee/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.979456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4dd7489edf94db982971ef1a23eaa17, user_id=06de9042d4e14337bcd1d47f0275b9ee, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.981056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:40.986770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:40.987814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:40.988752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:40.990064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 56/120] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:40.990916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.008210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 65/121] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:40 2022] PUT /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/06de9042d4e14337bcd1d47f0275b9ee/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:41.009092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.104028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.202488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad6ff1-a477-4f95-8eba-f87d0f849637 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.215685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398728-bcfe-4a99-9b5d-e03d7e4fe310 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.263927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.264782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.265066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.265344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.287263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.287940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.288256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.288536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.289298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:41.289395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:41.289604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.290975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:41.298633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:41.299583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:41.300340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:41.302596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 66/122] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.304587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 57/123] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:41.312128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.312712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.318293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.459431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb620-fc92-4d52-9b20-c5367bd69fe6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.481674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a342d-a0ef-4442-a39d-e6bccd60420d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.493757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7529b8-984f-4144-920e-6af5f855bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.494630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7529b8-984f-4144-920e-6af5f855bd9d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.494917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7529b8-984f-4144-920e-6af5f855bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.495189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7529b8-984f-4144-920e-6af5f855bd9d None admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.496481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7529b8-984f-4144-920e-6af5f855bd9d None admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.497938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7529b8-984f-4144-920e-6af5f855bd9d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.499574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 58/124] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.500850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dae22-bb1a-4030-9861-2285fa00c8ce None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.501139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dae22-bb1a-4030-9861-2285fa00c8ce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.501419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dae22-bb1a-4030-9861-2285fa00c8ce None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.502633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 59/125] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:41.508994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dae22-bb1a-4030-9861-2285fa00c8ce None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.509466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.546213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.547041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.547341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.547625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.548585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:41.549016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.550413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598b419-6447-4fb2-b4ef-0672a2d18524 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.567580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 67/126] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.568904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.569201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.569484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.590584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.613609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:41.614936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:41.631078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dae22-bb1a-4030-9861-2285fa00c8ce None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.666928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.667795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.668661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.668945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.670885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.672369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.675354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 60/127] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.675899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.761271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 68/128] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:41.762178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.882908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6386fd-e2e8-4995-b682-af4187b69fe9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.888340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.922450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.923571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.924117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.924195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/6dda363092bb44769e4fcafaa65574cd/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.926239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4dd7489edf94db982971ef1a23eaa17, user_id=6dda363092bb44769e4fcafaa65574cd, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.927694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.936208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450eb3a-18ca-4de1-b824-3909c5f07aa9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.954053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 69/129] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:41 2022] PUT /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/6dda363092bb44769e4fcafaa65574cd/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:41.954641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.037412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.038228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.038515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.038797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.042607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.044208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.046025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 61/130] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.052054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.069697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.161681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7532d1-4b62-418f-acb9-1d1835d71759 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.201830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.202754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.203053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.203338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.215176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:42.223285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:42.224292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:42.225363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 70/131] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:42.231282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.252422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6f22e-eb44-481c-a5f3-1e81b3587585 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.269869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.314658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.315511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.315807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.316120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.320820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.322334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.325492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 62/132] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.330931 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.346998 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee2df-c7de-4537-8e79-730984809cfc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.382641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.383325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.383620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.383900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.384826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:42.385241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.387241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.396308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 71/133] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:42.403138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.466606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.494549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace9dfe-c6c1-4cac-b223-23218c7a6be2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.533388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.534312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.534600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.534880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/06de9042d4e14337bcd1d47f0275b9ee/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.537416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d4dd7489edf94db982971ef1a23eaa17, user_id=06de9042d4e14337bcd1d47f0275b9ee, role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.538887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.559662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 63/134] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:42 2022] PUT /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/06de9042d4e14337bcd1d47f0275b9ee/roles/7607d90167e342db84bf7531c1ee5b29 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:42.628355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.648855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737d2c3-f414-4c71-aeee-f8aa1665f7a8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.700798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.701704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.701991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.702271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.703620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.705115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.706816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 72/135] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.713200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.848269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541885-bad9-4870-827d-bcb9e444d3ed None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.884935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270ecc1-ebdd-49c0-b652-4122949e29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.885731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ecc1-ebdd-49c0-b652-4122949e29ee None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.886020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ecc1-ebdd-49c0-b652-4122949e29ee None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.886303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ecc1-ebdd-49c0-b652-4122949e29ee None admin] PATH_INFO: `/v3/projects/e12734cdeb064a48b515fb538241bf59` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.887584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ecc1-ebdd-49c0-b652-4122949e29ee None admin] RBAC: Authorizing `identity:get_project(project_id=e12734cdeb064a48b515fb538241bf59)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.889076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ecc1-ebdd-49c0-b652-4122949e29ee None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.891060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 64/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/projects/e12734cdeb064a48b515fb538241bf59 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.896599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.921512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67936-0da3-4644-85cb-f43307322fa8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.921833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67936-0da3-4644-85cb-f43307322fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.922074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67936-0da3-4644-85cb-f43307322fa8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.923706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 65/137] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:42.929269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.929567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.930009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.948439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.954782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:42.956112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:43.083466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 66/138] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:43.094069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f329fa-356a-4181-9ebe-771302a83719 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.127672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.172798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.173713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.174000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.174278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] PATH_INFO: `/v3/projects/e12734cdeb064a48b515fb538241bf59/users/06de9042d4e14337bcd1d47f0275b9ee/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.179191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] RBAC: Authorizing `identity:create_grant(project_id=e12734cdeb064a48b515fb538241bf59, user_id=06de9042d4e14337bcd1d47f0275b9ee, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.180690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.210352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 73/139] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:42 2022] PUT /identity/v3/projects/e12734cdeb064a48b515fb538241bf59/users/06de9042d4e14337bcd1d47f0275b9ee/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:43.294772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5159-2db3-4fb7-8291-a632e000351c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.337746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.346766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e640f40-8182-4a15-a50a-4b3bb4a96338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.347585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e640f40-8182-4a15-a50a-4b3bb4a96338 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.347870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e640f40-8182-4a15-a50a-4b3bb4a96338 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.348175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e640f40-8182-4a15-a50a-4b3bb4a96338 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.349370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e640f40-8182-4a15-a50a-4b3bb4a96338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.350851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e640f40-8182-4a15-a50a-4b3bb4a96338 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.352692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 67/140] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.358678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.378555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.437712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4ef7-53e4-4370-bc5f-ed6a9641a448 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.438020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4ef7-53e4-4370-bc5f-ed6a9641a448 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.438200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4ef7-53e4-4370-bc5f-ed6a9641a448 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.439680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 68/141] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:43.444886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.445173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.445455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.463959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:43.465938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:43.510273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09c10-6015-4377-923d-be52b736df99 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.571271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.571974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.572305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.572842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.573592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.575609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.605009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 74/142] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:43 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:43.618898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 69/143] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:43.642769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.746547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.792035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23c77-9e7b-4d7b-8809-3601778bde82 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.831544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959ca45-0385-4a4e-852c-d9c808a60756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.832381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ca45-0385-4a4e-852c-d9c808a60756 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.832664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ca45-0385-4a4e-852c-d9c808a60756 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.832942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ca45-0385-4a4e-852c-d9c808a60756 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.843859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959ca45-0385-4a4e-852c-d9c808a60756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8959ca45-0385-4a4e-852c-d9c808a60756 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:43.856414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:43.857641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:43.858382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 75/144] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:43.866252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.003298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c441518-a8b0-4511-8e1e-648564abd9e1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.022352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02c57-bea3-45d1-a38d-8822f6d2643d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.022665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02c57-bea3-45d1-a38d-8822f6d2643d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.022923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02c57-bea3-45d1-a38d-8822f6d2643d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.024483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 76/145] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:44.029658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.030232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.030660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.038221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:44.050051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.050605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:44.050732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.051002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.051284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.052044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:44.052394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:44.052993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:44.053783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:44.072823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 70/146] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:44.078720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.183838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 77/147] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:44.248541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef2b3-b54c-4588-a5ac-20033d662ab9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.254485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.338101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.339355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.339902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.340454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] PATH_INFO: `/v3/users/827e6785bc5c4d529c096df67585bf2f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.343031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] RBAC: Authorizing `identity:get_user(user_id=827e6785bc5c4d529c096df67585bf2f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:44.345617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:44.353513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 71/148] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:44 2022] GET /identity/v3/users/827e6785bc5c4d529c096df67585bf2f => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:44.354635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.375875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:44.452899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975990b0-71bf-439b-8606-6c8d6729fc4c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.465512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:44.531079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541153c-e231-47fd-a8ac-0de6abd15a11 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.531249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.531838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.532153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.532433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.556093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:44.561799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:44.562651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:44.563410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 78/149] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:44.569661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.584935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.586190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.586760 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.587227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.592903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:44.594623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:44.596631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 72/150] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:44 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:44.602434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.744099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c2c1b-5dd0-45ac-9ee3-9bf99f02c617 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.758299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94077e-f708-49ee-9b93-6b4e18f0a22a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.773237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:44.808282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:44.812801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.813499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.813791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.814088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.814831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:44.815167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:44.816576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:44.824856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.826051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.826516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.826962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/827e6785bc5c4d529c096df67585bf2f/roles/ce5ed55c56cd47568cf0cbe03f23d08e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.829259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d4dd7489edf94db982971ef1a23eaa17, user_id=827e6785bc5c4d529c096df67585bf2f, role_id=ce5ed55c56cd47568cf0cbe03f23d08e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:44.830917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:44.832757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 79/151] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:44.838507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.854381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 73/152] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:44 2022] PUT /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17/users/827e6785bc5c4d529c096df67585bf2f/roles/ce5ed55c56cd47568cf0cbe03f23d08e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:45.002573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76138b6a-e7d6-4aac-9e2d-17ced7275757 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:45.047458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:45.048626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.049059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.049501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.050932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:45.052573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:45.054681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 80/153] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:44 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:45.061258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:45.214367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583a04b-a106-4f27-ae28-c51a407596ed None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:45.256107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15762b-435d-4586-9b2e-28183b6adbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:45.256768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15762b-435d-4586-9b2e-28183b6adbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.257053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15762b-435d-4586-9b2e-28183b6adbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.257337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15762b-435d-4586-9b2e-28183b6adbd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.330939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:45.347998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15762b-435d-4586-9b2e-28183b6adbd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:45.349581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15762b-435d-4586-9b2e-28183b6adbd1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:45.463258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 74/154] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:45.469132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:45.563049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:45.564075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831364-8075-484a-84ad-f2334f7936df None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.564634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831364-8075-484a-84ad-f2334f7936df None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.565121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831364-8075-484a-84ad-f2334f7936df None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.566709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 75/155] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:45.572129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.572921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.573414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.605174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:45.606780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:45.630907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea67a-aad5-479c-86c8-d46b67ad595c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:45.681726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:45.682878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.683317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.684304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.685687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:45.687301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:45.689228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 81/156] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:45 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:45.701128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:45.715614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 76/157] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:45.757564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:45.788420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:45.847849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af794d-59eb-4066-9f6b-8a3638d80364 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:45.884323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:45.914005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef674b1-8cfb-4502-b3eb-9e376d61923d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:45.915921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:45.916846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.917270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.917694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.919201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=06de9042d4e14337bcd1d47f0275b9ee) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:45.919647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:45.921343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b55cfb-5dba-4e5e-b0dc-e17cd6588071 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:45.931957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 82/158] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:45 2022] GET /identity/v3/role_assignments?user.id=06de9042d4e14337bcd1d47f0275b9ee&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:45.941682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420e88-2755-4eb6-b820-3d5ba11c72cd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.942199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420e88-2755-4eb6-b820-3d5ba11c72cd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.942625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420e88-2755-4eb6-b820-3d5ba11c72cd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.944202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 83/159] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:45.950754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.951284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.951726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:45.981116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:45.988153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:45.993538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:45.994361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:45.994804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:45.995239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.022056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:46.031233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:46.036407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:46.037342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:46.039761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 77/160] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:46.046319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.098771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 84/161] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:46.161586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.193833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:46.233104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1e38-bd05-490e-874d-507b56d5b905 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.296502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.297193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.297481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.297756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.298521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:46.298830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:46.300258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:46.320363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 78/162] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:46.321898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.322002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63606d1b-a8c1-467f-b31a-f423f420896d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.337840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:46.385360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.386179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.386463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.386813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.397586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:46.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:46.407592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:46.408390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:46.411042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 85/163] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:46.416477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.462247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429d910-0e68-4c63-9f99-1cc2c0faf5bd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.513847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.515065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.515499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.515925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.520771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:46.522367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:46.524204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 79/164] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:46.530107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.551333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:46.568342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957efd-ca2a-4a33-9602-9728ec37807e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.623634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.624581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.625011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.625435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.626370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:46.626827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:46.628380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:46.641607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 86/165] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:46.648990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.691228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:46.746733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2bed-9c93-4e21-8ec5-e1df9b1eda06 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.783459 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479602-541a-4c80-ae36-4ab8388f56a3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.805899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2c6fb-7e01-4863-b71a-57b73ccbbc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.806897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c6fb-7e01-4863-b71a-57b73ccbbc6a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.807372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c6fb-7e01-4863-b71a-57b73ccbbc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.807971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c6fb-7e01-4863-b71a-57b73ccbbc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.830240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.831667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.833041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.834291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] PATH_INFO: `/v3/users/6dda363092bb44769e4fcafaa65574cd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.835952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] RBAC: Authorizing `identity:get_user(user_id=6dda363092bb44769e4fcafaa65574cd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:46.838736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:46.840900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 87/166] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/users/6dda363092bb44769e4fcafaa65574cd => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:46.846421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.946724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2c6fb-7e01-4863-b71a-57b73ccbbc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:46.948400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2c6fb-7e01-4863-b71a-57b73ccbbc6a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:46.967218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.036551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.042576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340dca2-e0eb-4f48-bf6d-34e3254b4119 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.105867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53808047-8b5b-430d-a5b6-53e07c223256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.106914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808047-8b5b-430d-a5b6-53e07c223256 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.107399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808047-8b5b-430d-a5b6-53e07c223256 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.107871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808047-8b5b-430d-a5b6-53e07c223256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.223203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 80/167] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:47.224548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186af4-9d87-4bf0-9a82-5ac4739a0dce None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.224847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186af4-9d87-4bf0-9a82-5ac4739a0dce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.225106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0186af4-9d87-4bf0-9a82-5ac4739a0dce None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.226472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 81/168] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:47.240394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.240683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.240982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.245141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53808047-8b5b-430d-a5b6-53e07c223256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.247184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53808047-8b5b-430d-a5b6-53e07c223256 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.277068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:47.278321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:47.447509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 82/169] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:47.448943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.456746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.466815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 88/170] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:47.468507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8414f5-aea5-47d5-9bea-614685173776 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.469058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8414f5-aea5-47d5-9bea-614685173776 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.469565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8414f5-aea5-47d5-9bea-614685173776 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.471063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 89/171] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:47.476997 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8414f5-aea5-47d5-9bea-614685173776 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.529694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.635228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac37536-8dc5-482d-bb44-5e9d86e48b79 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.669140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8414f5-aea5-47d5-9bea-614685173776 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.671275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b10ca-6279-41db-960c-8a98634ea941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.672050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b10ca-6279-41db-960c-8a98634ea941 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.672354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b10ca-6279-41db-960c-8a98634ea941 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.672636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b10ca-6279-41db-960c-8a98634ea941 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.673809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b10ca-6279-41db-960c-8a98634ea941 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.675366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b10ca-6279-41db-960c-8a98634ea941 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.677256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 83/172] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:47.678290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.678570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.678844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.695630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:47.696895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:47.717363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.718551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.719060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.719550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.725314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.728130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.730087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 90/173] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:47.731196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.786163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 84/174] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:47.787020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.849721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.860465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.916088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676a32-e7b4-409f-bc16-e300f08d5e3e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.946950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.952096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.952096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.952096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.960375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787ca2-2835-4d16-920c-a162b8e2e81e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.973023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:47.985761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:47.986636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:47.987389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 91/175] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:47.988989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.017704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.018740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.019216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.019682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.020755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] RBAC: Adding query filter params (role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=06de9042d4e14337bcd1d47f0275b9ee) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:48.021266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.022904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.030401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 85/176] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/role_assignments?user.id=06de9042d4e14337bcd1d47f0275b9ee&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.031505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.144381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.149591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e4802-ccfb-47df-8a03-ed0645e1fc85 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.173062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff99cc-7484-44c9-8f54-2755906656db None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.194488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.195858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.197964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.198713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.221176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.224208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:48.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:48.237048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:48.237810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:48.245282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.246403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.246882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.247372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.248468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=6dda363092bb44769e4fcafaa65574cd) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:48.248989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.250678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.251896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 86/177] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:48.253041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.267404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 92/178] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/role_assignments?user.id=6dda363092bb44769e4fcafaa65574cd&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.270065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.413707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731fb2-9bc4-42c4-9248-12ac9de32d5f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.442392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb441b-a8b8-4fee-9d62-45cc44343a94 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.454741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.455811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.456328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.456822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.457918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:48.458430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.460165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f12ff-08e2-4c8f-89ed-79f3309eefa5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.470508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 87/179] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.472169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1b35-f126-46b7-9215-dd269eb25a37 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.472675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1b35-f126-46b7-9215-dd269eb25a37 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.473144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1b35-f126-46b7-9215-dd269eb25a37 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.474592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 88/180] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:48.475598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1b35-f126-46b7-9215-dd269eb25a37 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.490154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.490662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.490946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.491232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.492090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:48.492380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.493774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20294d8-d5c3-4d0c-adfe-2b6dd5c28a5b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.505218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.513236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 93/181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.514982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.515540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.516016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.540978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:48.542673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:48.624961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.630421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1b35-f126-46b7-9215-dd269eb25a37 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.646614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 94/182] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:48.647747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.674956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362568-b4d1-41f7-9379-4af5d6856a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.675914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362568-b4d1-41f7-9379-4af5d6856a81 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.676229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362568-b4d1-41f7-9379-4af5d6856a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.676562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362568-b4d1-41f7-9379-4af5d6856a81 None admin] PATH_INFO: `/v3/users/06de9042d4e14337bcd1d47f0275b9ee` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.678096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362568-b4d1-41f7-9379-4af5d6856a81 None admin] RBAC: Authorizing `identity:get_user(user_id=06de9042d4e14337bcd1d47f0275b9ee)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.680358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362568-b4d1-41f7-9379-4af5d6856a81 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.682976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 89/183] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/users/06de9042d4e14337bcd1d47f0275b9ee => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.685186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4be70-703a-4f9e-a30d-5f93ac72587a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.685471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4be70-703a-4f9e-a30d-5f93ac72587a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.685748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4be70-703a-4f9e-a30d-5f93ac72587a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.688143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 90/184] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:48.689294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4be70-703a-4f9e-a30d-5f93ac72587a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.763981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc49c54-8b76-4505-8bc4-8d9ba33e2efd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.789892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.801533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4be70-703a-4f9e-a30d-5f93ac72587a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.808636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.809505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.809783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.810054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] PATH_INFO: `/v3/users/1d2e26945b7549d294b6e5cc4fbc7854` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.824709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] RBAC: Authorizing `identity:get_user(user_id=1d2e26945b7549d294b6e5cc4fbc7854)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.826342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.828120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 95/185] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/users/1d2e26945b7549d294b6e5cc4fbc7854 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.828881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.843288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237c42-9b56-4cea-8ff7-17dde542432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.844112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237c42-9b56-4cea-8ff7-17dde542432f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.844401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237c42-9b56-4cea-8ff7-17dde542432f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.844675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237c42-9b56-4cea-8ff7-17dde542432f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.845830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237c42-9b56-4cea-8ff7-17dde542432f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.847291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237c42-9b56-4cea-8ff7-17dde542432f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.848930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 91/186] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.850130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.850416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.850693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.868637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:48.869860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:48.882120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.935699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 92/187] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:48.948275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.948375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe3f6e-7dac-49ea-9f4f-957decf680ea None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.974665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.975313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.976004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.976323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.022734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.035407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3723-5d2a-4d9d-949a-15fc5bf77252 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.042725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.044749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.068343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd0df3-8da6-4005-8379-a69376c3f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.068984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd0df3-8da6-4005-8379-a69376c3f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.069297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd0df3-8da6-4005-8379-a69376c3f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.069575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd0df3-8da6-4005-8379-a69376c3f4b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.085276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.135626 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd0df3-8da6-4005-8379-a69376c3f4b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.137658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd0df3-8da6-4005-8379-a69376c3f4b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.142904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 96/188] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:49.143719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.222990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.238035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 93/189] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:49.239305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecc13f-9452-480a-9de4-badac0c1856e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.239598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecc13f-9452-480a-9de4-badac0c1856e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.239879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecc13f-9452-480a-9de4-badac0c1856e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.241178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 94/190] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:49.241877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecc13f-9452-480a-9de4-badac0c1856e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.246834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02585-7cc6-4861-a302-eaa222b544cf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.280979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.281582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.281867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.282148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.282855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.284342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.299541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.305514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 97/191] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:49 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:49.306471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.362128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecc13f-9452-480a-9de4-badac0c1856e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.401360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.402699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.402998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.403273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.414660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:49.419586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168caee-86a2-49a8-a646-a84647964331 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:49.422912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:49.423853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 95/192] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:49.430146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.464364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541fcd0-06ba-4f7d-90f7-b92414226148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.465255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541fcd0-06ba-4f7d-90f7-b92414226148 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.466309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541fcd0-06ba-4f7d-90f7-b92414226148 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.466617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541fcd0-06ba-4f7d-90f7-b92414226148 None admin] PATH_INFO: `/v3/projects/e12734cdeb064a48b515fb538241bf59` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.467845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541fcd0-06ba-4f7d-90f7-b92414226148 None admin] RBAC: Authorizing `identity:get_project(project_id=e12734cdeb064a48b515fb538241bf59)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.469330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541fcd0-06ba-4f7d-90f7-b92414226148 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.471587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 98/193] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/projects/e12734cdeb064a48b515fb538241bf59 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:49.472377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.474065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.474065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.491176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:49.492412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:49.494103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.558994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812327f-99fc-4ec3-9815-373c8d5ed8cb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.566736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.581418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 99/194] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:49.582282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.609382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.610728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.611300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.611586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.612974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.615028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.617477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 96/195] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:49.618351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.718535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8971f-e0cc-4b79-8da3-2c455588e1ac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.731088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255c1-1a89-40e4-8a59-29495c19aab2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.749058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.768543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.769219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.769502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.769781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.770535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:49.770843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.772879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.776032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.776708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.777044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.777354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.778190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=e12734cdeb064a48b515fb538241bf59, user.id=06de9042d4e14337bcd1d47f0275b9ee) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:49.778502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.779929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.786896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 97/196] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/role_assignments?user.id=06de9042d4e14337bcd1d47f0275b9ee&scope.project.id=e12734cdeb064a48b515fb538241bf59&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:49.787974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.793645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 100/197] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:49.794753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:49.881356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.925281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a865ce9-e4bb-4acf-9191-6c04db9da27b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.970138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.970963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.971241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.971513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.988393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1add9-f827-4232-8b57-8b1c6d543de2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.001476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:50.010253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:50.011168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 98/198] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:50.012037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.043269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.043915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.044226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.044503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.045329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=1d2e26945b7549d294b6e5cc4fbc7854) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:50.045656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.047181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.053207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 101/199] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:49 2022] GET /identity/v3/role_assignments?user.id=1d2e26945b7549d294b6e5cc4fbc7854&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:50.054103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.070662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.179851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896da95-50cd-43ae-be8d-8b8faf9c0bb6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.207431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.225712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865f0af-b009-49b1-8f10-4107c81e513f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.231159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.231845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.232153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.232428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.233194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:50.233517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.234902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.255146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 102/200] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:50.261674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.299558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.300527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.300805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.301076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] PATH_INFO: `/v3/users/827e6785bc5c4d529c096df67585bf2f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.303634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] RBAC: Authorizing `identity:get_user(user_id=827e6785bc5c4d529c096df67585bf2f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.305278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.307272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 99/201] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/users/827e6785bc5c4d529c096df67585bf2f => generated 289 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:50.314633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.429351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9c3c-a903-49c9-8543-ef0fbf9c485a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.444464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.470304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.471273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.471778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.472289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.475666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fc8a6-8e13-4f7e-a669-20723738031e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.534884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.538247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.538743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.539273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] PATH_INFO: `/v3/users/1d2e26945b7549d294b6e5cc4fbc7854` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.541510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1d2e26945b7549d294b6e5cc4fbc7854)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.544793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.553263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 103/202] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/users/1d2e26945b7549d294b6e5cc4fbc7854 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:50.555964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.612392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.614845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.656333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.725783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f38d4e-5d4a-4577-b152-894e64aa41f3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.774335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 100/203] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:50.780504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.799361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.808371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.809406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.809854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.832449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.897197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc187030-764e-4c51-ada4-a853244f5f4c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.936163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.937023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.937305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.937835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.939423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.941231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.943772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 101/204] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:50.949825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.005017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.006427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.048552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.064738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e836-8413-49df-8138-ee00c76c37a0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.103585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.104318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.104655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.105078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.106453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] RBAC: Adding query filter params (role.id=ce5ed55c56cd47568cf0cbe03f23d08e, scope.project.id=d4dd7489edf94db982971ef1a23eaa17, user.id=827e6785bc5c4d529c096df67585bf2f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:51.106769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.108557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.114934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 102/205] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/role_assignments?user.id=827e6785bc5c4d529c096df67585bf2f&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=ce5ed55c56cd47568cf0cbe03f23d08e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:51.169465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.236190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 104/206] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:51.244730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.372147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f428-06c0-4cc3-ada1-67ba41ac9e85 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.418536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cb20f-cb1c-4e27-8794-3d5cd1b8308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.419402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb20f-cb1c-4e27-8794-3d5cd1b8308e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.419683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb20f-cb1c-4e27-8794-3d5cd1b8308e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.419955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb20f-cb1c-4e27-8794-3d5cd1b8308e None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.421211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cb20f-cb1c-4e27-8794-3d5cd1b8308e None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.422667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cb20f-cb1c-4e27-8794-3d5cd1b8308e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.425143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 103/207] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:51.430993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.541882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4237-e33d-4077-9746-fd4146b3accc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.581492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.582170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.582458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.582742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.583584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] RBAC: Adding query filter params (role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=1d2e26945b7549d294b6e5cc4fbc7854) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:51.583959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.585529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631b05-3ef8-46a5-b9c4-ce027c569cd4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.593255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 105/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/role_assignments?user.id=1d2e26945b7549d294b6e5cc4fbc7854&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:51.677396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532715-9fcc-4801-a26e-d28347748b26 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.677711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532715-9fcc-4801-a26e-d28347748b26 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.677956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532715-9fcc-4801-a26e-d28347748b26 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.679559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 104/209] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:51.685732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95203ea6-0502-4466-b084-fd545655fcde None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.686026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95203ea6-0502-4466-b084-fd545655fcde None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.686354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95203ea6-0502-4466-b084-fd545655fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.705098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-95203ea6-0502-4466-b084-fd545655fcde None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:51.706380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-95203ea6-0502-4466-b084-fd545655fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:51.721726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.789515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 106/210] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:51.816105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4532715-9fcc-4801-a26e-d28347748b26 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.829481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.889286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb87f5-b262-4aaf-b93d-4c2ed5658619 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.889827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb87f5-b262-4aaf-b93d-4c2ed5658619 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.889827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb87f5-b262-4aaf-b93d-4c2ed5658619 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.891367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 107/211] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:51.896164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.896662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.897149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.913902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:51.915382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:51.934522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4532715-9fcc-4801-a26e-d28347748b26 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.971977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.972978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.973253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.973531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.997823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:52.007503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.008397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:52.009627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:52.013179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 105/212] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.014787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 108/213] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:52.020118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.045775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.097282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.143954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.149269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946c0c-1ac3-40d0-8bbb-d69867d7d68a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.170305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e27b1-d289-407a-b9a1-193109712a33 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.196373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.198250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.198704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.199663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.201192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.201800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.203716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.208978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.209888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.210512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.210628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.211911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.213513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.218910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 109/215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:52.219036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 106/215] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.219835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.220972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.333528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c53d-8490-4235-9494-1f64e9077a00 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.356303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b6e56-60a8-480b-a80d-da1b79cf47b0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.373035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.382676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.383915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.384465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.385132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.386616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.388645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.394254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e46a5-c394-491a-84e5-0884ce75bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.395253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e46a5-c394-491a-84e5-0884ce75bea8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.395611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e46a5-c394-491a-84e5-0884ce75bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.395963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e46a5-c394-491a-84e5-0884ce75bea8 None admin] PATH_INFO: `/v3/users/434d96f6b51843e0af82a0a6b64ac9e8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.418478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 107/216] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:52 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:52.420281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e46a5-c394-491a-84e5-0884ce75bea8 None admin] RBAC: Authorizing `identity:get_user(user_id=434d96f6b51843e0af82a0a6b64ac9e8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.421601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e46a5-c394-491a-84e5-0884ce75bea8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.423561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 110/217] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/users/434d96f6b51843e0af82a0a6b64ac9e8 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.433439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.437789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4723e-5357-407f-9076-d85203928949 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.438079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4723e-5357-407f-9076-d85203928949 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.438483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4723e-5357-407f-9076-d85203928949 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.444363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 111/218] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:52.448427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.449008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.449442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.454896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.469876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:52.471123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:52.551630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 112/219] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:52.565551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f3192-4900-415b-bbc8-54370c5f868f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.575570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.606261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.607152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.607575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.607990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.675411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.693902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.695734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.697857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955b888-a28e-41c8-a31c-f9fb99844d2b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.737643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.743151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.744370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.744748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.745137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.756515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:52.764799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.765865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:52.766859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 113/220] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:52.772541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.814763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 108/221] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:52.820468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.906146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f218af-c047-4500-980c-c3497ee2547c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.939811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.961796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.963080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.963570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.964051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.965132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.965898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.969188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.973572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f1878-dc4e-4828-b87d-059d54634405 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.980764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 114/222] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:52.985913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.051493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.052811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.053373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.060494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.061873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.063334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.065389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 109/223] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:53.071971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.076487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.124985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56444f28-bb49-4b1c-8cf9-c86b6499d43c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.182660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.184088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.184371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.184653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] PATH_INFO: `/v3/users/1d2e26945b7549d294b6e5cc4fbc7854` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.189351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] RBAC: Authorizing `identity:get_user(user_id=1d2e26945b7549d294b6e5cc4fbc7854)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.190823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.192549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 115/224] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/users/1d2e26945b7549d294b6e5cc4fbc7854 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:53.198204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.237034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d55de-fd1b-4f76-ad1a-b02139ed0c8b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.289579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.291199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.291673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.292126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.293889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=434d96f6b51843e0af82a0a6b64ac9e8) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:53.296538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.298139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.305439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 110/225] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/role_assignments?user.id=434d96f6b51843e0af82a0a6b64ac9e8&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:53.386272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056428-c44b-4816-8f7f-fef69f5a3d02 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.412425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.423149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763faa9-a6ab-4c51-b4c8-3c27c70d5a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.424044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763faa9-a6ab-4c51-b4c8-3c27c70d5a84 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.428481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763faa9-a6ab-4c51-b4c8-3c27c70d5a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.428763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763faa9-a6ab-4c51-b4c8-3c27c70d5a84 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.430171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763faa9-a6ab-4c51-b4c8-3c27c70d5a84 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.431670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763faa9-a6ab-4c51-b4c8-3c27c70d5a84 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.435405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 116/226] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:53.440255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.482007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.578311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fc1e2-7871-4aa5-a253-ae0f1afecb22 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.613325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f2ac-f13d-481c-b601-eed6cfaed213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.614570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f2ac-f13d-481c-b601-eed6cfaed213 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.615048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f2ac-f13d-481c-b601-eed6cfaed213 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.615517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f2ac-f13d-481c-b601-eed6cfaed213 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/1d2e26945b7549d294b6e5cc4fbc7854/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.617734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f2ac-f13d-481c-b601-eed6cfaed213 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user_id=1d2e26945b7549d294b6e5cc4fbc7854, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.619501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f2ac-f13d-481c-b601-eed6cfaed213 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.639029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 111/227] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:53 2022] PUT /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/1d2e26945b7549d294b6e5cc4fbc7854/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:53.904175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e6d8-0e8c-4141-b4cf-b2316c05b236 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.904487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e6d8-0e8c-4141-b4cf-b2316c05b236 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.904731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e6d8-0e8c-4141-b4cf-b2316c05b236 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.906112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 117/228] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:53.911359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.911875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.912412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.932144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:53.934176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:54.023608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 112/229] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:54.058785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e6d8-0e8c-4141-b4cf-b2316c05b236 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.193442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e6d8-0e8c-4141-b4cf-b2316c05b236 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.240742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335234-004a-4243-97c8-2e2763616200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.241554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335234-004a-4243-97c8-2e2763616200 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.241838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335234-004a-4243-97c8-2e2763616200 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.242115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335234-004a-4243-97c8-2e2763616200 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.256911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46335234-004a-4243-97c8-2e2763616200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-46335234-004a-4243-97c8-2e2763616200 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:54.265121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:54.265968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:54.266729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 118/230] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:54.273139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.294632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.423470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14061096-80f7-41a8-a1c2-aa03ebc25dda None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.471518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.472946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.473424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.473935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.474877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:54.475445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.477057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.491171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 113/231] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:54.497422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335234-004a-4243-97c8-2e2763616200 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.574594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.638104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335234-004a-4243-97c8-2e2763616200 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.679361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.680272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.680556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.680831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] PATH_INFO: `/v3/users/1d2e26945b7549d294b6e5cc4fbc7854` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.682048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] RBAC: Authorizing `identity:get_user(user_id=1d2e26945b7549d294b6e5cc4fbc7854)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.684026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.685796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 119/232] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/users/1d2e26945b7549d294b6e5cc4fbc7854 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:54.691274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.800406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.840190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d3718-7c23-451b-9a68-c820766cd28e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.893516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ad6ba-382a-491e-b059-3abd701d1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.894397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad6ba-382a-491e-b059-3abd701d1d04 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.894684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad6ba-382a-491e-b059-3abd701d1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.894966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad6ba-382a-491e-b059-3abd701d1d04 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.896211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ad6ba-382a-491e-b059-3abd701d1d04 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.897674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ad6ba-382a-491e-b059-3abd701d1d04 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.899392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 114/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:54.905177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.066801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36559e-5450-487a-8ced-a737ce42135b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.091869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.118088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c6137-d043-4ca8-b317-7c27d23d83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.118978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c6137-d043-4ca8-b317-7c27d23d83c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.119258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c6137-d043-4ca8-b317-7c27d23d83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.119530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c6137-d043-4ca8-b317-7c27d23d83c5 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/1d2e26945b7549d294b6e5cc4fbc7854/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.121914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c6137-d043-4ca8-b317-7c27d23d83c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user_id=1d2e26945b7549d294b6e5cc4fbc7854, role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.123357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c6137-d043-4ca8-b317-7c27d23d83c5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.149810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 120/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:54 2022] PUT /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/1d2e26945b7549d294b6e5cc4fbc7854/roles/7607d90167e342db84bf7531c1ee5b29 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:55.187601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86b1f-8c75-4ca9-a69d-da50f918fb25 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.187911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86b1f-8c75-4ca9-a69d-da50f918fb25 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.188247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86b1f-8c75-4ca9-a69d-da50f918fb25 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.189697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 115/235] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:55.195699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.195987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.196297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.223474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:55.224723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:55.247312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26041e-c038-48e1-b36b-e07b085072b3 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.247641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26041e-c038-48e1-b36b-e07b085072b3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.247873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26041e-c038-48e1-b36b-e07b085072b3 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.249341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 116/236] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:55.255047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.255336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.255619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.273947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:55.275228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:55.364877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 121/237] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:55.384980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:55.391418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.412743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.513087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0875-f1ac-488a-9033-70cb28807137 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.532437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.533143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.559169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.559972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.560277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.560549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.566372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.567834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.578670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 122/239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.579512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.608192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5991-0fb4-4f76-909c-05505db67c27 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.650607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.651324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.651604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.653410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.675445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:55.683230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:55.685358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:55.687306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:55.697918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 118/240] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:55.703826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.802230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c4e3-baab-427d-9bb9-43b98feb2858 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.831410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ff1e-bff0-436d-8652-4c4d79e1a6e5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.871893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.886763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.887443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.887730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.888009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.888815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.889126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.891597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49573d58-8f40-4dbb-97aa-d574808c82ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.902181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 119/241] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.904533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d221c2d-a0b5-4a83-bdd8-3598d79b575e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.904927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d221c2d-a0b5-4a83-bdd8-3598d79b575e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.905386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d221c2d-a0b5-4a83-bdd8-3598d79b575e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.906780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e211-669f-4cfc-93eb-2f90556b72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.907122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 120/242] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:55.907894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d221c2d-a0b5-4a83-bdd8-3598d79b575e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.909444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e211-669f-4cfc-93eb-2f90556b72c0 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.909891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e211-669f-4cfc-93eb-2f90556b72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.910337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e211-669f-4cfc-93eb-2f90556b72c0 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.911087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e211-669f-4cfc-93eb-2f90556b72c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.915479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e211-669f-4cfc-93eb-2f90556b72c0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.938362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 123/243] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:55 2022] POST /identity/v3/users => generated 293 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:55.940090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.940392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.940679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.963282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:55.965903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:56.028799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.107925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d221c2d-a0b5-4a83-bdd8-3598d79b575e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.117031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 124/244] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:56.156744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.162838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.163988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.164517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.165126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] PATH_INFO: `/v3/users/6d1f9974f415402a9334dac33ab729f3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.181161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] RBAC: Authorizing `identity:get_user(user_id=6d1f9974f415402a9334dac33ab729f3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:56.182906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:56.185998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 121/245] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/users/6d1f9974f415402a9334dac33ab729f3 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:56.191606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.246754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.282526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab5e0-b9d3-4dc6-a3c2-75bac2802d15 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.306376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f43344-5f59-421e-a7ef-5a2ac725ee6e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.320660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.321463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.321741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.322014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.332932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:56.341164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:56.342069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:56.347856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 125/246] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:56.350597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.360778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ea5b2-97cd-4da2-a775-a2d12e99496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.361515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ea5b2-97cd-4da2-a775-a2d12e99496b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.361806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ea5b2-97cd-4da2-a775-a2d12e99496b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.362141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ea5b2-97cd-4da2-a775-a2d12e99496b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.378055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.454552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ea5b2-97cd-4da2-a775-a2d12e99496b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:56.459749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ea5b2-97cd-4da2-a775-a2d12e99496b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:56.474262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6311e8-6520-4a4a-b797-cc1fff59d520 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.518457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.519616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.520109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.520648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.521552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:56.522160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.522860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:56.524583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ec05d-9992-46ce-b2eb-f09939d4ff4d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:56.535037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 126/247] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:56.536389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d258-2e00-4b9c-bff4-65887b2f903f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.536684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d258-2e00-4b9c-bff4-65887b2f903f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.536965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d258-2e00-4b9c-bff4-65887b2f903f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.538277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 127/248] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:56.544242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d258-2e00-4b9c-bff4-65887b2f903f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.596657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 122/249] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:56.598146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.598443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.598727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.618239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:56.619505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:56.650723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.680748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d258-2e00-4b9c-bff4-65887b2f903f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.720709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 123/250] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:56.728647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.758202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.759089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.759383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.759664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] PATH_INFO: `/v3/users/434d96f6b51843e0af82a0a6b64ac9e8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.762152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] RBAC: Authorizing `identity:get_user(user_id=434d96f6b51843e0af82a0a6b64ac9e8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:56.763603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:56.765320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 128/251] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/users/434d96f6b51843e0af82a0a6b64ac9e8 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:56.774331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.917313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496a59-1b12-4355-8688-8f53c6baf36d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.930364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.964301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836504f-9edd-44df-8ee6-f2d6a838c942 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.979102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.980381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.980910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.981204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.984850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:56.986334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:56.988272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 129/252] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:56.990332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.011735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.012983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.013466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.013943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.015423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.017153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.019415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 124/253] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:57.020462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.043980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.170112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540eb7-95db-4652-89ab-843ab8cd994c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.193410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70a50-58e5-4d0b-a812-60fb981c56d6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.233378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507af413-a294-4404-ae86-11b081563601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.234200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af413-a294-4404-ae86-11b081563601 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.234479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af413-a294-4404-ae86-11b081563601 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.234759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af413-a294-4404-ae86-11b081563601 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/434d96f6b51843e0af82a0a6b64ac9e8/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.237882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507af413-a294-4404-ae86-11b081563601 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user_id=434d96f6b51843e0af82a0a6b64ac9e8, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.239329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507af413-a294-4404-ae86-11b081563601 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.258488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 125/254] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:57 2022] PUT /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/434d96f6b51843e0af82a0a6b64ac9e8/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:57.259421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507af413-a294-4404-ae86-11b081563601 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.273109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.273996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.274286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.274564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.280028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.296447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:57.304468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:57.305827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:57.306606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:39:57.313836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 130/255] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:57.320678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.434739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507af413-a294-4404-ae86-11b081563601 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.477855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.478538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.478824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.479106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.479966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] RBAC: Adding query filter params (role.id=ce5ed55c56cd47568cf0cbe03f23d08e, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=6d1f9974f415402a9334dac33ab729f3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:57.480345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.481837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.498248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 126/256] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/role_assignments?user.id=6d1f9974f415402a9334dac33ab729f3&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=ce5ed55c56cd47568cf0cbe03f23d08e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:57.512471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.537643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78097af0-47c4-40b8-ad36-76b11f9d2f70 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.586080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.586778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.587069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.587416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.588217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:57.588569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.590465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cde1a-1766-47f0-905e-50bc0ef27f36 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.604616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 131/257] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:57.610543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.624449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491bc3-fcb2-4cab-a176-0cd634c7b729 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.624767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491bc3-fcb2-4cab-a176-0cd634c7b729 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.625072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491bc3-fcb2-4cab-a176-0cd634c7b729 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.628888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 132/258] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:57.634596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.634883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.635162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.667085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:57.668824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:57.704606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.743010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544361-3704-40ed-bc34-9c1ff21550b1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.777879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 133/259] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:57.792992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.793922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.794203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.794479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] PATH_INFO: `/v3/users/1d2e26945b7549d294b6e5cc4fbc7854` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.801120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=1d2e26945b7549d294b6e5cc4fbc7854)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.802639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.804803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 127/260] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/users/1d2e26945b7549d294b6e5cc4fbc7854 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:57.810598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.815586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.924624 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.955374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20931fae-0e99-465e-b259-85663d06bc8b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.996770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.997768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.998276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.998746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.081228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52d01-f100-4055-8556-ea058c77b1f2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.160783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.161607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.161899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.162184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.178194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.179630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.181316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.187082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:58.200715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:58.201589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:39:58.202354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 128/261] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:58.212987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.329858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.400798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 134/262] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:58.405910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.416079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a807c8-d918-4b08-ba77-b92e5bce0bce None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.484893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.485842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.486136 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.486422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.487642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:58.487962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.489599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.508091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 129/263] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:58.516757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.612492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.655882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94818313-3068-4ce8-931e-3c50043435a0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.668721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a6836-a837-47e2-afdb-6204a9ad9bdd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.725324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.726212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.726496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.726772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] PATH_INFO: `/v3/users/1d2e26945b7549d294b6e5cc4fbc7854` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.732779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] RBAC: Authorizing `identity:get_user(user_id=1d2e26945b7549d294b6e5cc4fbc7854)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.734242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.736236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 130/264] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/users/1d2e26945b7549d294b6e5cc4fbc7854 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:58.741246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.743536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.744440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.744726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.745009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.746276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.747728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.756549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 135/265] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:58.757412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.890136 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6573-2ad4-45ca-ae51-3d0ab8420392 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.907174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.932087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.941057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.941990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.942472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.942946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.041261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dab8b0-000c-4b9e-aa07-03d21a04256a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.061345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.062872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.112016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.112642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.112927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.113206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.114056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=1d2e26945b7549d294b6e5cc4fbc7854) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.114372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.115839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9abb17-c249-4705-b3b9-4e96059619fa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.131137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 136/266] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/role_assignments?user.id=1d2e26945b7549d294b6e5cc4fbc7854&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.132541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acadf0a-7fa0-4d37-8813-41497c383f2f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.132833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acadf0a-7fa0-4d37-8813-41497c383f2f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.133115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acadf0a-7fa0-4d37-8813-41497c383f2f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.134472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 137/267] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:59.149874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677883a-89e2-4fbb-8c01-1ab0a06697eb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.150195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677883a-89e2-4fbb-8c01-1ab0a06697eb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.150436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677883a-89e2-4fbb-8c01-1ab0a06697eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.182712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e677883a-89e2-4fbb-8c01-1ab0a06697eb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:59.184428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e677883a-89e2-4fbb-8c01-1ab0a06697eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:59.262963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 131/268] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:59.267225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 138/269] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:59.269183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.285856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba0c8-46a9-404a-9656-f0b43924e639 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.286365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba0c8-46a9-404a-9656-f0b43924e639 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.286784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba0c8-46a9-404a-9656-f0b43924e639 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.289071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 139/270] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:59.293685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba0c8-46a9-404a-9656-f0b43924e639 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.311271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.365744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.423504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6201d-01c8-4336-b399-66164773457b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.468952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba0c8-46a9-404a-9656-f0b43924e639 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.477166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8bf19-0bf8-4937-adc4-910d169fba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.478138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bf19-0bf8-4937-adc4-910d169fba65 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.478496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bf19-0bf8-4937-adc4-910d169fba65 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.478843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8bf19-0bf8-4937-adc4-910d169fba65 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.481780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8bf19-0bf8-4937-adc4-910d169fba65 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.483331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8bf19-0bf8-4937-adc4-910d169fba65 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.488755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 132/271] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.489261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.489621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.489992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.509153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:59.510474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:59.516207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.517279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.517737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.518177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.519668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.521467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.523779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 140/272] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.524885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.627845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 133/273] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:59.629313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.687708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8cd6-0c96-4ab2-be10-c10fd77b598e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.690846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.709651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.760121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.762493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.763051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.763567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.765477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] RBAC: Adding query filter params (role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=1d2e26945b7549d294b6e5cc4fbc7854) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.766644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.768484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.777682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 141/274] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/role_assignments?user.id=1d2e26945b7549d294b6e5cc4fbc7854&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.784258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.967999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639901ed-85b5-4db0-b98f-b3369ea8dbfb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.999782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda099-1e25-4810-9723-1c190205025c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.077745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.078479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.078766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.079054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.081908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15ca7-a3ce-4001-8817-a80b2bcab0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.082579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15ca7-a3ce-4001-8817-a80b2bcab0d2 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.082857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15ca7-a3ce-4001-8817-a80b2bcab0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.083128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15ca7-a3ce-4001-8817-a80b2bcab0d2 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.083841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15ca7-a3ce-4001-8817-a80b2bcab0d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.085313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15ca7-a3ce-4001-8817-a80b2bcab0d2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.090334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:00.099822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.100826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:00.101676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 142/275] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.108452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.116896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 134/276] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:59 2022] POST /identity/v3/users => generated 293 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:00.146180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.233542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be64445-edf1-4f9a-8aff-61a51a4b8035 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.247119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaba06d-6945-4ba2-8d10-facd61efd46f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.247406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaba06d-6945-4ba2-8d10-facd61efd46f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.247690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaba06d-6945-4ba2-8d10-facd61efd46f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.250882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 135/277] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:00.255835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e9cd-7830-4fd6-a7c2-bd54388525e7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.256171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e9cd-7830-4fd6-a7c2-bd54388525e7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.256455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e9cd-7830-4fd6-a7c2-bd54388525e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.274508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3557e9cd-7830-4fd6-a7c2-bd54388525e7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:00.275741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3557e9cd-7830-4fd6-a7c2-bd54388525e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:00.281140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.281815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.282096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.282367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.283121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.283424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.284851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ddff-98d9-488a-80a2-8da7511965f4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.295723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 143/278] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:00.297057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2831c1a-7d56-48cf-9ebf-08172ef87f9c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.297347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2831c1a-7d56-48cf-9ebf-08172ef87f9c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.297621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2831c1a-7d56-48cf-9ebf-08172ef87f9c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.299048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 144/279] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:00.303843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2831c1a-7d56-48cf-9ebf-08172ef87f9c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.361208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 136/280] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:00.362442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.362731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.363009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.382165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:00.383332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:00.392142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.409286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.426103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2831c1a-7d56-48cf-9ebf-08172ef87f9c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.466161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 137/281] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:00.467519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.474398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.475311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.475595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.475869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] PATH_INFO: `/v3/users/30b02e5cd8a84555b5db439a45c382eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.493762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] RBAC: Authorizing `identity:get_user(user_id=30b02e5cd8a84555b5db439a45c382eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.495366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.497969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 145/282] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/users/30b02e5cd8a84555b5db439a45c382eb => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.500885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.584357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eaa94-1e6e-4ec1-8d1e-544b9d3c98a7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.621196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.621969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.622255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.622530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.630187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb276e-cbff-4973-a75b-e79cc7446829 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.632618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:00.640647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.641571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:00.642351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 138/283] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.642983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.646923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.677841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.679165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.680309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.684411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.700448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:00.711391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.712314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:00.713094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:00.713688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 146/284] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.715102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.730522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.769701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e4b2e-8c08-43c4-bfbb-004f61dba889 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.805453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.806111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.806390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.806665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.807494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, user.id=30b02e5cd8a84555b5db439a45c382eb, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.807805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.810161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.816026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 139/285] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/role_assignments?user.id=30b02e5cd8a84555b5db439a45c382eb&scope.system=all&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.816689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.848555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0451-2b7e-4f23-80b0-cfe18e83f8b2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.904181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.904181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.904181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.904181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.904565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.904565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.904565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.911199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.922484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 147/286] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.925839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.985146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df282-d0fb-45ba-a027-4f654648fd35 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.028455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.055827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.056620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.056901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.057175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.058033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:01.058454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.059930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.069301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 140/287] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.076544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f894d6f-6c75-41b1-ac41-ec698928deb5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.076995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.153344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.154653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.155137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.155611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] PATH_INFO: `/v3/users/6d1f9974f415402a9334dac33ab729f3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.160771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] RBAC: Authorizing `identity:get_user(user_id=6d1f9974f415402a9334dac33ab729f3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.162430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.164307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 148/288] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/users/6d1f9974f415402a9334dac33ab729f3 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.170263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.205025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c4500-62b5-436c-95b1-1ced000cea7d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.232522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.240829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.241806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.242174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.242460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] PATH_INFO: `/v3/users/434d96f6b51843e0af82a0a6b64ac9e8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.243692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] RBAC: Authorizing `identity:get_user(user_id=434d96f6b51843e0af82a0a6b64ac9e8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.245467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.248370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 141/289] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/users/434d96f6b51843e0af82a0a6b64ac9e8 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.253324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.379316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43930e87-c72a-42b6-9c99-84252e125b19 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.443549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251b67-fee5-4bbd-b79a-b300e545ad90 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.444306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.445438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.445726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.446007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.449568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.451006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.460217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 149/290] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:01.468188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.475682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.497474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.498135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.498425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.498808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.564727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.572306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.574241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.679918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd176-0414-46f2-b658-5d3b5908e1f7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.682378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 142/291] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:01.693179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.725164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.726082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.726365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.726646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/6d1f9974f415402a9334dac33ab729f3/roles/ce5ed55c56cd47568cf0cbe03f23d08e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.733551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] RBAC: Authorizing `identity:create_grant(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user_id=6d1f9974f415402a9334dac33ab729f3, role_id=ce5ed55c56cd47568cf0cbe03f23d08e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.735182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.762429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 150/292] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:01 2022] PUT /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/users/6d1f9974f415402a9334dac33ab729f3/roles/ce5ed55c56cd47568cf0cbe03f23d08e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:01.814273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.820713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5f07b-757d-43c8-bcb0-5453dba6c76b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.859795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12877f4d-95b0-47a7-a081-bc8d08b67639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.860716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12877f4d-95b0-47a7-a081-bc8d08b67639 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.861336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12877f4d-95b0-47a7-a081-bc8d08b67639 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.861616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12877f4d-95b0-47a7-a081-bc8d08b67639 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.862875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12877f4d-95b0-47a7-a081-bc8d08b67639 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.864749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12877f4d-95b0-47a7-a081-bc8d08b67639 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.866417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 143/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.877214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.988162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.029699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ee32-fe9a-407b-beb0-84c0d818312a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.066945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.067617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.067901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.068214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.069122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=434d96f6b51843e0af82a0a6b64ac9e8) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:02.069441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:02.070879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc053e34-5472-498b-bec1-bb6b0a15ab6d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:02.080483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 151/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/role_assignments?user.id=434d96f6b51843e0af82a0a6b64ac9e8&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:02.522028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb175f2c-e581-4fa0-800a-9879c1b2a60a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.522532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb175f2c-e581-4fa0-800a-9879c1b2a60a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.522922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb175f2c-e581-4fa0-800a-9879c1b2a60a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.524601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 144/295] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:02.529825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.530280 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.530465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.550853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:02.552048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:02.634222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 152/296] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:02.658581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb175f2c-e581-4fa0-800a-9879c1b2a60a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.764235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb175f2c-e581-4fa0-800a-9879c1b2a60a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.798818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b71f0-d41f-445e-ae3f-a2fd7c814328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.799539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b71f0-d41f-445e-ae3f-a2fd7c814328 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.799820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b71f0-d41f-445e-ae3f-a2fd7c814328 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.800115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b71f0-d41f-445e-ae3f-a2fd7c814328 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.811207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b71f0-d41f-445e-ae3f-a2fd7c814328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-287b71f0-d41f-445e-ae3f-a2fd7c814328 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:02.819188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:02.820092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:02.820878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 145/297] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:02.826983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.864892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bc45-cdec-4405-b440-9d0360d92a3e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.865196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bc45-cdec-4405-b440-9d0360d92a3e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.865469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bc45-cdec-4405-b440-9d0360d92a3e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.875530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 146/298] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:02.877042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.877486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.877768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.892526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.896659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:02.898273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:02.918479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.944544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e05c0-b421-4cd6-bef7-9457d0e4d4bd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.976281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 147/299] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:02.992769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.993653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.994080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.994498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.995421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:02.996409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:02.997969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.001361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.015916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 153/300] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:03.021231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.116130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e9d7-5258-4083-9491-683bf66742e7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.140538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9bc7-7c36-4ebd-9368-76c324a87a43 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.153080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.154185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.154669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.155120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.156509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.158145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.160264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 148/301] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:03.165597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.172485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.190168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.191141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.191489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.191833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] PATH_INFO: `/v3/users/3e9ad53b658049eba1dd7835a7f04286` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.197358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.212375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9ad53b658049eba1dd7835a7f04286)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.214094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.221246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 154/302] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/users/3e9ad53b658049eba1dd7835a7f04286 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:03.221748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.293857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a546b8-1ff3-4c3c-8afe-09c018726578 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.328616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1e2ae-2394-4a53-9d27-1955cec82f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.329279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1e2ae-2394-4a53-9d27-1955cec82f16 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.329560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1e2ae-2394-4a53-9d27-1955cec82f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.329835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1e2ae-2394-4a53-9d27-1955cec82f16 None admin] PATH_INFO: `/v3/groups` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.330514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1e2ae-2394-4a53-9d27-1955cec82f16 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.331653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac12d13-b774-44cc-a1e7-b9445a762c77 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.331930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1e2ae-2394-4a53-9d27-1955cec82f16 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.347267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 149/303] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 14 10:40:03 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:03.357708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327b7b-2eb4-4d68-9aa0-cdd9df035d3b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.358010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327b7b-2eb4-4d68-9aa0-cdd9df035d3b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.358265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa327b7b-2eb4-4d68-9aa0-cdd9df035d3b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.360100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 150/304] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:03.365873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.366482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.366934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.384675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:03.384871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.385386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.385733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.386015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.387420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:03.387527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] RBAC: Adding query filter params (role.id=ce5ed55c56cd47568cf0cbe03f23d08e, user.id=3e9ad53b658049eba1dd7835a7f04286, scope.system=all) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:03.387765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.389509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.399785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 155/305] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/role_assignments?user.id=3e9ad53b658049eba1dd7835a7f04286&scope.system=all&role.id=ce5ed55c56cd47568cf0cbe03f23d08e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:03.478988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 151/306] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:03.502479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.554333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.619250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2d722-5c42-4c17-8baa-5ec3ea510e4d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.653702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.654496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.654780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.655058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.665224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:03.673725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:03.674643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:03.675426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 156/307] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:03.682853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.695828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.801080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872971c-b84f-4687-bbd4-13d318ba4384 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.841722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.842399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.842687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.842960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.843712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:03.844019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.845439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.853951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 152/308] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:03.859684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.977061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a0592-4979-42ee-b646-93947263171c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.978551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.012722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469c35-0ec6-4c3a-9f4e-f2e790f6b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.013607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469c35-0ec6-4c3a-9f4e-f2e790f6b785 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.013886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469c35-0ec6-4c3a-9f4e-f2e790f6b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.014162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469c35-0ec6-4c3a-9f4e-f2e790f6b785 None admin] PATH_INFO: `/v3/users/30b02e5cd8a84555b5db439a45c382eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.015356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469c35-0ec6-4c3a-9f4e-f2e790f6b785 None admin] RBAC: Authorizing `identity:get_user(user_id=30b02e5cd8a84555b5db439a45c382eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.016820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469c35-0ec6-4c3a-9f4e-f2e790f6b785 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.018735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 157/309] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/users/30b02e5cd8a84555b5db439a45c382eb => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:04.024423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.100373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c56fb-4586-4843-ac7a-898af68d2e24 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.100770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c56fb-4586-4843-ac7a-898af68d2e24 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.101062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c56fb-4586-4843-ac7a-898af68d2e24 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.102788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 158/310] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:04.106688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.109406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.109686 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.109960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.129766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:04.131147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:04.133882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23637f00-a15b-4ace-9f00-a06315ff9d44 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.168917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.169789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.170074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.170355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] PATH_INFO: `/v3/system/users/30b02e5cd8a84555b5db439a45c382eb/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.171877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30b02e5cd8a84555b5db439a45c382eb, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.173322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.186070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 153/311] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 14 10:40:04 2022] PUT /identity/v3/system/users/30b02e5cd8a84555b5db439a45c382eb/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:04.215135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 159/312] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:04.240810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.353355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c60856-94c7-4c13-af27-833316e75666 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.391916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.393094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.393462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.393740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.401360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.407285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:04.415275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:04.416173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:04.416964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 154/313] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:04.422745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.524741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.528482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae15d4-863a-4fe7-b24d-4b208a2425cd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.564764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.565499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.565703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.565986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.566743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:04.567054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.568460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.577982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 160/314] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:04.583089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.694036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b194-9670-4b8d-b492-d1f1e84cfe29 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.730911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.731795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.732093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.732383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] PATH_INFO: `/v3/users/6d1f9974f415402a9334dac33ab729f3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.733601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] RBAC: Authorizing `identity:get_user(user_id=6d1f9974f415402a9334dac33ab729f3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.735048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.736708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 155/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/users/6d1f9974f415402a9334dac33ab729f3 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:04.742498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.844464 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea94fba-9ed5-46f4-b8c4-181365b68620 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.879786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec939-4065-4779-b619-be531b065a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.880466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec939-4065-4779-b619-be531b065a6c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.880750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec939-4065-4779-b619-be531b065a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.881021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec939-4065-4779-b619-be531b065a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.910508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.951532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec939-4065-4779-b619-be531b065a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.953024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec939-4065-4779-b619-be531b065a6c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.057037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 161/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:05.065225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.133326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.168150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57333-fbe8-44af-ade6-9e2dcb0b0d67 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.202447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016c210-05ca-4624-8a70-a102d44dfc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.203307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c210-05ca-4624-8a70-a102d44dfc4c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.203586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c210-05ca-4624-8a70-a102d44dfc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.203857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c210-05ca-4624-8a70-a102d44dfc4c None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.205060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016c210-05ca-4624-8a70-a102d44dfc4c None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.206493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016c210-05ca-4624-8a70-a102d44dfc4c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.208489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 156/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.214834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec939-4065-4779-b619-be531b065a6c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.278460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.318947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec939-4065-4779-b619-be531b065a6c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.354273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.355454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.355741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.356019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.356897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] RBAC: Adding query filter params (role.id=ce5ed55c56cd47568cf0cbe03f23d08e, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, user.id=6d1f9974f415402a9334dac33ab729f3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:05.357208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.358665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242159-00f0-4f93-8343-8279cacd6db2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.365090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 162/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/role_assignments?user.id=6d1f9974f415402a9334dac33ab729f3&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=ce5ed55c56cd47568cf0cbe03f23d08e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.544380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d4cd-7794-4876-aa27-ba0f777cf900 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.544763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d4cd-7794-4876-aa27-ba0f777cf900 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.544957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d4cd-7794-4876-aa27-ba0f777cf900 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.546551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 157/319] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:05.551811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.552140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.552426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.570105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:05.571441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:05.608926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d80e2-665f-4308-acc8-5fb4f31788b7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.608926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d80e2-665f-4308-acc8-5fb4f31788b7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.609210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d80e2-665f-4308-acc8-5fb4f31788b7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.610508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 158/320] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:05.615520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.615809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.616118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.632317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:05.633494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:05.649540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 163/321] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:05.672524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.705733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 159/322] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:05.727844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.734912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.782751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf25dc-181f-4fb5-9f8c-ad5703281dab None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.794061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.820657 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.821718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.822839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.823339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.825284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.826786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.828453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 164/323] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.833899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.835154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e2c4-cb09-4cfa-a111-186d2422ae8c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.877542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.878340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.878619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.878890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.890251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:05.897949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:05.898868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:05.899634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 160/324] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:05.905150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.945712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d3426-f302-456d-92a6-63ea85661576 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.971785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.983890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.984595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.984879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.985157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] PATH_INFO: `/v3/groups` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.985853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.987292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.004131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 165/325] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 14 10:40:05 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:06.017185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f9db-f43f-43e1-b586-b344ef4dfddc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.044215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.057269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.057964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.058777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.059059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.059839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.060195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.061649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.071188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 161/326] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:06.077471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.185987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc925-ecd2-4f1e-91dc-430897a6df7d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.221893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941bcce-3617-4f51-aae5-3541edeb319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.222763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bcce-3617-4f51-aae5-3541edeb319c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.223046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bcce-3617-4f51-aae5-3541edeb319c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.223321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bcce-3617-4f51-aae5-3541edeb319c None admin] PATH_INFO: `/v3/users/3e9ad53b658049eba1dd7835a7f04286` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.224583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941bcce-3617-4f51-aae5-3541edeb319c None admin] RBAC: Authorizing `identity:get_user(user_id=3e9ad53b658049eba1dd7835a7f04286)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.226030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941bcce-3617-4f51-aae5-3541edeb319c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.227838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 166/327] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/users/3e9ad53b658049eba1dd7835a7f04286 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.233986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.344039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ecf5-a858-4bca-b308-4e9c9274989d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.378478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762361b3-aea5-4f2b-9ac1-a6afd2d72316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.379352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762361b3-aea5-4f2b-9ac1-a6afd2d72316 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.379641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762361b3-aea5-4f2b-9ac1-a6afd2d72316 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.379921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762361b3-aea5-4f2b-9ac1-a6afd2d72316 None admin] PATH_INFO: `/v3/system/users/3e9ad53b658049eba1dd7835a7f04286/roles/ce5ed55c56cd47568cf0cbe03f23d08e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.381532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762361b3-aea5-4f2b-9ac1-a6afd2d72316 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e9ad53b658049eba1dd7835a7f04286, role_id=ce5ed55c56cd47568cf0cbe03f23d08e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.382960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762361b3-aea5-4f2b-9ac1-a6afd2d72316 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.392045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 162/328] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 14 10:40:06 2022] PUT /identity/v3/system/users/3e9ad53b658049eba1dd7835a7f04286/roles/ce5ed55c56cd47568cf0cbe03f23d08e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:06.449040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7d63-c85f-4480-83b2-14be03a3fdd2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.449365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7d63-c85f-4480-83b2-14be03a3fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.449599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7d63-c85f-4480-83b2-14be03a3fdd2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.451344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 167/329] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:06.457337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.457619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.457906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.476710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:06.478318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:06.536006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.567350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 163/330] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:06.587397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7d63-c85f-4480-83b2-14be03a3fdd2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.648191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.705640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7d63-c85f-4480-83b2-14be03a3fdd2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.746484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.747355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.747641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.747973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.758613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:06.766595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:06.767448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:06.768281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 168/331] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:06.774086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.893712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3d68-a404-48c4-ae6e-a7d440eab1a9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.930509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.931190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.931477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.931759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.932555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.933035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.934471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.943698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 164/332] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.950933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.096215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c30d9-581c-416d-9529-397a5efcf540 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.112643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.138522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529d3e-624c-42c3-bfb7-b94da8b8eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.139393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529d3e-624c-42c3-bfb7-b94da8b8eca5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.139681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529d3e-624c-42c3-bfb7-b94da8b8eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.139957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529d3e-624c-42c3-bfb7-b94da8b8eca5 None admin] PATH_INFO: `/v3/users/30b02e5cd8a84555b5db439a45c382eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.143406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529d3e-624c-42c3-bfb7-b94da8b8eca5 None admin] RBAC: Authorizing `identity:get_user(user_id=30b02e5cd8a84555b5db439a45c382eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.144937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529d3e-624c-42c3-bfb7-b94da8b8eca5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.146621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 169/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/users/30b02e5cd8a84555b5db439a45c382eb => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:07.153034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.204722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.268529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae183-4d4a-426e-bd1b-b71bdcc85a2d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.304362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.305014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.305309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.305579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.306418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] RBAC: Adding query filter params (role.id=48fbdd1d59bf4d1482c26dc9539019f7, user.id=30b02e5cd8a84555b5db439a45c382eb, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:07.306733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.308777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c336951-9571-4d07-940c-8457b94acb8f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.321329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 165/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/role_assignments?user.id=30b02e5cd8a84555b5db439a45c382eb&scope.system=all&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:08.551759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678be47-3a8d-49d4-a874-585daa056fbd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.552279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678be47-3a8d-49d4-a874-585daa056fbd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.552353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678be47-3a8d-49d4-a874-585daa056fbd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.554013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 170/335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:08.558912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.559329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.559500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.579561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:08.580834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:08.662330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 166/336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:08.701112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678be47-3a8d-49d4-a874-585daa056fbd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.809433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678be47-3a8d-49d4-a874-585daa056fbd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.849162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.849964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.850252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.850533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.879291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:08.887680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:08.888826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:08.889781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:08.891536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 171/337] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:08.896397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.934116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.018307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7855b8-d531-420f-abcf-f6f36d0f5805 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.062849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.063459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.063743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.064021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.064806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:09.065121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.066677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.076669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 167/338] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.082489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.131654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.193515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636d65-73e2-42be-8584-be78b6bd4fa5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.235511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb997ab7-8e45-4c87-8168-716f1e3b72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.236184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997ab7-8e45-4c87-8168-716f1e3b72ea None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.236469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997ab7-8e45-4c87-8168-716f1e3b72ea None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.236743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb997ab7-8e45-4c87-8168-716f1e3b72ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.316521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb997ab7-8e45-4c87-8168-716f1e3b72ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.317921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb997ab7-8e45-4c87-8168-716f1e3b72ea None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.381139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.432626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 172/339] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:09.438896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.486084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c428b01-bccc-4315-91b9-f0901a1c2292 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.486397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c428b01-bccc-4315-91b9-f0901a1c2292 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.486640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c428b01-bccc-4315-91b9-f0901a1c2292 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.488142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 173/340] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:09.494144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.494995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.495894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.516445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:09.517665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:09.612146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.622649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 174/341] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 10:40:09.628300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213609b4-bfb8-4143-834a-f361ba154eb9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.667077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.696557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1981807-349f-4f6e-87b2-05ce42fcdc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.697423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1981807-349f-4f6e-87b2-05ce42fcdc6e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.697959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1981807-349f-4f6e-87b2-05ce42fcdc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.698233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1981807-349f-4f6e-87b2-05ce42fcdc6e None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.699848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1981807-349f-4f6e-87b2-05ce42fcdc6e None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.701360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1981807-349f-4f6e-87b2-05ce42fcdc6e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.703461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 168/342] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.704772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895e7a-29d1-4160-8efa-2f90204bdbb6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.705064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895e7a-29d1-4160-8efa-2f90204bdbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.705343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895e7a-29d1-4160-8efa-2f90204bdbb6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.706583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 169/343] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:09.707723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a1385-306d-446c-abcc-c16d13c0b541 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.708024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a1385-306d-446c-abcc-c16d13c0b541 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.708351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a1385-306d-446c-abcc-c16d13c0b541 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.709803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 170/344] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:09.715039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a1385-306d-446c-abcc-c16d13c0b541 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.768101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.802141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cc343-4f1b-4dc1-80af-ae42e37abc89 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.830434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a1385-306d-446c-abcc-c16d13c0b541 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.843583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754130d-884c-45b3-88ad-1b437cb85f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.844648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754130d-884c-45b3-88ad-1b437cb85f34 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.845103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754130d-884c-45b3-88ad-1b437cb85f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.845522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754130d-884c-45b3-88ad-1b437cb85f34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.857119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754130d-884c-45b3-88ad-1b437cb85f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8754130d-884c-45b3-88ad-1b437cb85f34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:09.865202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:09.866107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:09.866897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:09.870751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 175/345] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:09.876085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df37558-7fda-4cf1-8d54-db6ed4752eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.876085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df37558-7fda-4cf1-8d54-db6ed4752eac None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.876085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df37558-7fda-4cf1-8d54-db6ed4752eac None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.876085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df37558-7fda-4cf1-8d54-db6ed4752eac None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.877099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.877567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.878031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.882120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df37558-7fda-4cf1-8d54-db6ed4752eac None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.883715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df37558-7fda-4cf1-8d54-db6ed4752eac None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.891026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 171/346] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.892536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.893337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.893337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.898690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:09.900085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:09.911662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:09.913048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:09.940486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.975572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 176/347] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:09.976484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.993642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 172/348] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:09.994414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.084980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.117442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e81d-d58c-4cf0-88a6-28132bdf4147 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.129803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dfbca-ddad-48f3-9dfd-48d22299cdcf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.154728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.155402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.155693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.155977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.156940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=d4dd7489edf94db982971ef1a23eaa17) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.157268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.158796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.165809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 173/349] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.172466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.174930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.175639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.175925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.176236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.177027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.177337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.178774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.216244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 177/350] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.217115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.218568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.347797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d1a3-7f46-4dad-a5cd-fc777631924e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.356876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c40b3-1dd9-4945-ace8-a591d2957f61 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.383725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.395627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29950-cca9-4bfc-9f04-d0652ae664ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.396577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29950-cca9-4bfc-9f04-d0652ae664ab None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.396954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29950-cca9-4bfc-9f04-d0652ae664ab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.397323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29950-cca9-4bfc-9f04-d0652ae664ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.398345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.399409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.399800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.400208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.410102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e29950-cca9-4bfc-9f04-d0652ae664ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:10.413207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-54e29950-cca9-4bfc-9f04-d0652ae664ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:10.419358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:10.420330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:40:10.421111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:10.423453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:10.424426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:10.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 178/351] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:10.426309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.428266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 174/352] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:10.431740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6bbb5-6f57-41bd-9e4f-4d73e1750fbc None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.431934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6bbb5-6f57-41bd-9e4f-4d73e1750fbc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.432244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6bbb5-6f57-41bd-9e4f-4d73e1750fbc None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.435770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 175/353] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:10.436609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6bbb5-6f57-41bd-9e4f-4d73e1750fbc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.527734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.544721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da639e7-b1f9-4cb0-a1ea-2d6dadc5b886 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.554361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6bbb5-6f57-41bd-9e4f-4d73e1750fbc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.585625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.586344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.586638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.586925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.597463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.598141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.598427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.598707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.599556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.599868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.601973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.611117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 176/354] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.611964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.644525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.664774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.666446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.727520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ad554-c61e-4b12-98de-164d8e1097c1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.762783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.763464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.763747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.764030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.764810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.765117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.766575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43851334-f7ca-41e2-b55e-b74bbca703c2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.775035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 177/355] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.781521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.781815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.782097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.782550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 179/356] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:10.783462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.788315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.802687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:10.803982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:10.877562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 178/357] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:10.878515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.884512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.895568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662bf7c-fdd2-4533-bb36-5137f416c6b3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.933816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.935540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.935827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.936129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] PATH_INFO: `/v3/users/3e9ad53b658049eba1dd7835a7f04286` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.938106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] RBAC: Authorizing `identity:get_user(user_id=3e9ad53b658049eba1dd7835a7f04286)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.940117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.942833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 180/358] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/users/3e9ad53b658049eba1dd7835a7f04286 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.943927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.030508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e7d7-d390-412a-9f96-3db67345747d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.067880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd549-dac2-4a5a-8e3f-a80dc548cdfd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.073440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.082440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.083213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.083526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.084037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.114005 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.115330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.115618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.115896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.120834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.122598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.125036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 181/359] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.127753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.151096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.177552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.179015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.253877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c6c2-fe5b-41e6-9a61-3fe95dde3df8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.298275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 179/360] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:11.298275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.307255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3bd6d-7d50-43af-8732-d8f52ab6cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.309066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3bd6d-7d50-43af-8732-d8f52ab6cf16 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.309352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3bd6d-7d50-43af-8732-d8f52ab6cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.309661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3bd6d-7d50-43af-8732-d8f52ab6cf16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.321673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3bd6d-7d50-43af-8732-d8f52ab6cf16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2cf3bd6d-7d50-43af-8732-d8f52ab6cf16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:11.331742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:11.332717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:11.334267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:11.334967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.335038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 182/361] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:11.335038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a954-f0b5-4dde-bb7f-b5abe27ab54e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.335038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a954-f0b5-4dde-bb7f-b5abe27ab54e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.335038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a954-f0b5-4dde-bb7f-b5abe27ab54e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.336484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 183/362] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:11.337386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4a954-f0b5-4dde-bb7f-b5abe27ab54e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.434603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023f3b-9a3f-4361-84ca-c1d388a7ff0e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.440468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.476267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4a954-f0b5-4dde-bb7f-b5abe27ab54e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.485433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.485433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.485693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.486365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.487223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] RBAC: Adding query filter params (role.id=ce5ed55c56cd47568cf0cbe03f23d08e, user.id=3e9ad53b658049eba1dd7835a7f04286, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.487534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.490550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.509971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 180/363] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/role_assignments?user.id=3e9ad53b658049eba1dd7835a7f04286&scope.system=all&role.id=ce5ed55c56cd47568cf0cbe03f23d08e => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.510815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.534622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632e3b-0135-44d1-b1d9-27a53449d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.535877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632e3b-0135-44d1-b1d9-27a53449d185 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.536384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632e3b-0135-44d1-b1d9-27a53449d185 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.536608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632e3b-0135-44d1-b1d9-27a53449d185 None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.537993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632e3b-0135-44d1-b1d9-27a53449d185 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.539495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632e3b-0135-44d1-b1d9-27a53449d185 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.541683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 184/364] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.543421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.543700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.543980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.562508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:11.563210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:11.630077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.643497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 185/365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:11.644392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.645107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd83883-39ce-48de-9e97-46e65a389734 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.684055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.685388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.685878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.686383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.688039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.689768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.692011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 181/366] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.695987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.729924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.756755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5e15-7ff8-4f68-8c2d-8c2d43c4b69d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.799744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.800446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.800733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.801008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.801820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.802129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.803973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.816455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 186/367] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.817316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.831528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed7d3-0c04-4bf1-af57-b9f1c7d4ad81 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.879301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.880395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.880749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.881104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.882021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.882709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.883794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.891355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 182/368] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.892322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.921982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.956868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554ba0-5c48-4066-bae6-8b281fea9e7b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.998745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.999985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.000428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.000920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.008869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d6c9-3357-4416-af24-20e4ea4f22e8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.010036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.015654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:12.024420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:12.025603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:12.026481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:12.029236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 187/369] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:12.030241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.056591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.057226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.057514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.057795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.059117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.060641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.062627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 183/370] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.069653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.157751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9ddc-19a8-4737-acf1-78ff98c5f39a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.192458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.205533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.206413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.206557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9428c-7791-4f7c-ba5b-4ed545f71462 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.207019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.207441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.253709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.254397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.255563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.255872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.256675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.257547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.259004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.271705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 184/371] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.272916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.294420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.300342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.302462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.409380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b996f-7abc-40a0-afc8-bcafc10131c9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.423662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 188/372] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:12.429098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.454057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.454732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.455019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.455302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.456169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=d4dd7489edf94db982971ef1a23eaa17) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.456489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.458001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.464225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 185/373] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.464860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.502170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.543050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.547863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55afa-140a-4739-8640-ee040f94378f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.591432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f102d-6a68-4338-8b4b-a2fe9dcf0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.592178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f102d-6a68-4338-8b4b-a2fe9dcf0dec None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.592466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f102d-6a68-4338-8b4b-a2fe9dcf0dec None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.592747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f102d-6a68-4338-8b4b-a2fe9dcf0dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.611054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd6c7b-b4de-4240-b976-cf422da5ae03 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.655670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e3543-70a9-419a-8fbe-45161baf1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.656952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3543-70a9-419a-8fbe-45161baf1319 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.657440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3543-70a9-419a-8fbe-45161baf1319 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.657915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e3543-70a9-419a-8fbe-45161baf1319 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.659340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e3543-70a9-419a-8fbe-45161baf1319 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.661036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e3543-70a9-419a-8fbe-45161baf1319 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.663025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 186/374] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.664652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2aa1a-ab6a-4948-bb42-c1fda6b36029 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.665145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2aa1a-ab6a-4948-bb42-c1fda6b36029 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.665968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2aa1a-ab6a-4948-bb42-c1fda6b36029 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.668659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 187/375] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:12.674386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2aa1a-ab6a-4948-bb42-c1fda6b36029 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.675873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f102d-6a68-4338-8b4b-a2fe9dcf0dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.677423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f102d-6a68-4338-8b4b-a2fe9dcf0dec None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.792012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.797323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.797716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 189/376] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:12.802582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.802582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.802582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.818959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:12.820344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:12.826279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2aa1a-ab6a-4948-bb42-c1fda6b36029 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.881171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.882308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.882712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.883071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.884421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.886484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.889571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 188/377] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.890458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.916381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 190/378] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:12.917533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.018042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fcdc9-7e0b-495b-aa28-0b83387be77e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.030747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22060d1-8de1-4568-8d29-79b83d4df5ee None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.056659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.057562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.057951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.058323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] PATH_INFO: `/v3/projects/2dceb4db085a4305881c3af4908bb6f8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.059631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] RBAC: Authorizing `identity:get_project(project_id=2dceb4db085a4305881c3af4908bb6f8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.061181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.062977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.063100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 189/379] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/projects/2dceb4db085a4305881c3af4908bb6f8 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:13.064489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.072437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.074134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.074606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.075078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.076171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:13.076677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.078404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.084989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 191/380] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:13.086061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.092592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.189749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a9def-5035-4be6-bf26-ed38cb72f690 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.201780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bc6fd-5714-4406-943c-eba1767d435a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.229769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.230675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.230962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.231246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.240638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.242307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.242814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.243311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] PATH_INFO: `/v3/groups/eb8cd57b58c6419f8d85f934b600d09c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.244576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:13.251517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] RBAC: Authorizing `identity:get_group(group_id=eb8cd57b58c6419f8d85f934b600d09c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:13.253446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:13.254670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:13.255529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 190/381] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:13.257293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.259808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 192/382] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:13 2022] GET /identity/v3/groups/eb8cd57b58c6419f8d85f934b600d09c => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:13.264584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.268267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.343887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.402590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c507f-27f8-4d26-bbc2-c020df827e54 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.403445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75526e-29fe-4ac3-856a-35ca1f49dbe7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.412592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.446888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.448251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.448710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.449086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.450324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] RBAC: Adding query filter params (group.id=eb8cd57b58c6419f8d85f934b600d09c, role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=2dceb4db085a4305881c3af4908bb6f8) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:13.450759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.452337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.453820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.454641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.454943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.455223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.458358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:13.458690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.459567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 193/383] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:13 2022] GET /identity/v3/role_assignments?group.id=eb8cd57b58c6419f8d85f934b600d09c&scope.project.id=2dceb4db085a4305881c3af4908bb6f8&role.id=195f05d542f14d7b93230878b428d9eb => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:13.461227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.476239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 191/384] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:13.482793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.618660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf449c-277d-4f16-a205-05a1f698351e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.652576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.668281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.669155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.669436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.669710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.670928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.672386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.674332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 194/385] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:13 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:13.679628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.801008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ffbdb-abc1-4523-8135-ffc44d538959 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.843194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e101839-745c-431b-9632-33eb9e3188cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.844439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e101839-745c-431b-9632-33eb9e3188cc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.844960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e101839-745c-431b-9632-33eb9e3188cc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.845480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e101839-745c-431b-9632-33eb9e3188cc None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.852841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e101839-745c-431b-9632-33eb9e3188cc None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.854605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e101839-745c-431b-9632-33eb9e3188cc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.857539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 192/386] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:13 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:13.869432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.990433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afc3d-f849-4c9f-b067-8312e7c2c03f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:14.028566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a277e-d6e7-4ec6-916b-655f3aee7a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:14.029451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a277e-d6e7-4ec6-916b-655f3aee7a9b None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.029733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a277e-d6e7-4ec6-916b-655f3aee7a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.029999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a277e-d6e7-4ec6-916b-655f3aee7a9b None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17/groups/6a7b1809bf254102a5883a838c04b14e/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.031953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a277e-d6e7-4ec6-916b-655f3aee7a9b None admin] RBAC: Authorizing `identity:create_grant(project_id=d4dd7489edf94db982971ef1a23eaa17, group_id=6a7b1809bf254102a5883a838c04b14e, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:14.033422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a277e-d6e7-4ec6-916b-655f3aee7a9b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:14.053650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 195/387] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 14 10:40:13 2022] PUT /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17/groups/6a7b1809bf254102a5883a838c04b14e/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:14.488682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246e93-3ea1-4ee9-8199-4ccdae53c549 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.489215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246e93-3ea1-4ee9-8199-4ccdae53c549 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.489215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246e93-3ea1-4ee9-8199-4ccdae53c549 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.490907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 193/388] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:14.495841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.496185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.496504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.516457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:14.517647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:14.571189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:14.597708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 196/389] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:14.631286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246e93-3ea1-4ee9-8199-4ccdae53c549 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:14.645608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:14.751696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246e93-3ea1-4ee9-8199-4ccdae53c549 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:14.797901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:14.798706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.798996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.799276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.817079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:14.825795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:14.826682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:14.827459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:14.831830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 194/390] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:14.832916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:14.988018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05fe1-9ad6-4484-836d-67f2a4d40a7b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.030603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.031202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.031487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.031764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.032549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:15.032867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.034231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31616401-7999-4396-b2f4-af9cfa12e453 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.047874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 197/391] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:15.053411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.164597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.215998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464593-6174-41b7-a70a-ce980d45fbcf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.259326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895374-7176-49eb-868a-69d09b7681fe None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.260018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895374-7176-49eb-868a-69d09b7681fe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.260534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895374-7176-49eb-868a-69d09b7681fe None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.262176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 198/392] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:15.269537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.270081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.270581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.273756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.274728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.275016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.275296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.276624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.278080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.280113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 195/393] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:15.285206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.293227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:15.294778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:15.348964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.388997 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 199/394] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:15.420311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.420662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f7ce-4a80-429b-8937-87bbd51fb788 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.459319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.460386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.460778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.461218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.462576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.464846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.467810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 196/395] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:15.477026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.486885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.545557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719f1e-bcb2-42d2-9a4e-f966ab1f8db8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.587795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.589775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.590673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.591178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.614136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:15.631480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:15.632488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:15.633260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 200/396] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:15.640370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.685619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29c9e-b83c-424e-9a2b-fe232c876643 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.700601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.748039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b79a9-f73f-41fe-ac35-73ad1354b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.748981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b79a9-f73f-41fe-ac35-73ad1354b2b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.749269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b79a9-f73f-41fe-ac35-73ad1354b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.749546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b79a9-f73f-41fe-ac35-73ad1354b2b4 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/groups/6a7b1809bf254102a5883a838c04b14e/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.752852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b79a9-f73f-41fe-ac35-73ad1354b2b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, group_id=6a7b1809bf254102a5883a838c04b14e, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.754297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b79a9-f73f-41fe-ac35-73ad1354b2b4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.779314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 197/397] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 14 10:40:15 2022] PUT /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/groups/6a7b1809bf254102a5883a838c04b14e/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:15.780727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c3ebb-5c86-491d-b138-b0a7cdf8c80e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.781069 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c3ebb-5c86-491d-b138-b0a7cdf8c80e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.781407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c3ebb-5c86-491d-b138-b0a7cdf8c80e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.783023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 198/398] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:15.791222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.791565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.791780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.821757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:15.823162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:15.834078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7a1a-ab4b-4a42-8222-74ac8832a41d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.903931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.904645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.904925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.905200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.905970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:15.906354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.907689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.918122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 201/399] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:15.924898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.952605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.963167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 199/400] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:15.994422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.062186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.079124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041175a-9690-41b6-8c43-3058e23af2ab None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.120101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8888f4e-bf7b-4dda-babb-3bd8a955c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.121863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888f4e-bf7b-4dda-babb-3bd8a955c4cb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.122141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888f4e-bf7b-4dda-babb-3bd8a955c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.122886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888f4e-bf7b-4dda-babb-3bd8a955c4cb None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.124294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8888f4e-bf7b-4dda-babb-3bd8a955c4cb None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.126365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8888f4e-bf7b-4dda-babb-3bd8a955c4cb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.128181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 202/401] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:16.129825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c36d-2c28-4f18-9eb9-e744025fae94 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.130112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c36d-2c28-4f18-9eb9-e744025fae94 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.130392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c36d-2c28-4f18-9eb9-e744025fae94 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.131870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 203/402] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:16.136840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c36d-2c28-4f18-9eb9-e744025fae94 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.147660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64337-007b-41c7-90ff-376ba7e08cfc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.186314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06762b02-9b82-4db4-b6cc-310a0619cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.187211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06762b02-9b82-4db4-b6cc-310a0619cb33 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.187570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06762b02-9b82-4db4-b6cc-310a0619cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.187920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06762b02-9b82-4db4-b6cc-310a0619cb33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.199679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06762b02-9b82-4db4-b6cc-310a0619cb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-06762b02-9b82-4db4-b6cc-310a0619cb33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:16.207584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:16.208491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:16.209338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 200/403] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:16.211299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.211656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.212012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.229223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:16.230546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:16.270916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c36d-2c28-4f18-9eb9-e744025fae94 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.287106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.306092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 201/404] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:16.307097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.308999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.310021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.310362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.310642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.311956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.313469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.315478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 204/405] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:16.330304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.375720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.441729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c152b-3c1e-4e79-a68d-4846573eeeaf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.456838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc22d50-c1c2-403a-83ac-3929d617c2af None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.490185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.491241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.491845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.492361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.492678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.493560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.493666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:16.493843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.494120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17/groups/6a7b1809bf254102a5883a838c04b14e/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.494542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.496298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.496572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4dd7489edf94db982971ef1a23eaa17, group_id=6a7b1809bf254102a5883a838c04b14e, role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.498049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.507596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 202/406] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:16.508886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.515016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 205/407] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 14 10:40:16 2022] PUT /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17/groups/6a7b1809bf254102a5883a838c04b14e/roles/7607d90167e342db84bf7531c1ee5b29 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:16.523002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.569235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.628483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a1732-edbb-4279-a6fb-9275f3a876fe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.693071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.694916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.697983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.699149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.702529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.720790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:16.735282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd688-4c5b-4a02-a204-4384ef6532b4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:16.736918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:16.737786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:16.738542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 203/408] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:16.744342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.784462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.786399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.787157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.787679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] PATH_INFO: `/v3/groups/eb8cd57b58c6419f8d85f934b600d09c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.790527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] RBAC: Authorizing `identity:get_group(group_id=eb8cd57b58c6419f8d85f934b600d09c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.792966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.796317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 206/409] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/groups/eb8cd57b58c6419f8d85f934b600d09c => generated 229 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:16.801175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.906620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce01e2-ae91-446c-a14b-bfa1defca1b5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.926435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.944872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a773e7-d25a-4c54-801d-536567acb961 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.987111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.988395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.989307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.990225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] PATH_INFO: `/v3/projects/2dceb4db085a4305881c3af4908bb6f8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.992308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] RBAC: Authorizing `identity:get_project(project_id=2dceb4db085a4305881c3af4908bb6f8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.994351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.995771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.996899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.998821 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 207/410] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/projects/2dceb4db085a4305881c3af4908bb6f8 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:16.999361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.999793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.000819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.001296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.002811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.005490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.024399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 204/411] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.025354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.042079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.130133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bdfc-927e-4feb-bb99-922ee1c3f890 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.172000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf74289-400a-472e-883c-7022cb35d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.173427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74289-400a-472e-883c-7022cb35d919 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.173712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74289-400a-472e-883c-7022cb35d919 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.173991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74289-400a-472e-883c-7022cb35d919 None admin] PATH_INFO: `/v3/projects/2dceb4db085a4305881c3af4908bb6f8/groups/eb8cd57b58c6419f8d85f934b600d09c/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.178671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf74289-400a-472e-883c-7022cb35d919 None admin] RBAC: Authorizing `identity:create_grant(project_id=2dceb4db085a4305881c3af4908bb6f8, group_id=eb8cd57b58c6419f8d85f934b600d09c, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.180144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf74289-400a-472e-883c-7022cb35d919 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.203475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 208/412] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 14 10:40:17 2022] PUT /identity/v3/projects/2dceb4db085a4305881c3af4908bb6f8/groups/eb8cd57b58c6419f8d85f934b600d09c/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:17.205269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4ee0-04c7-465c-b5b7-6c39e64c3b1a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.205564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4ee0-04c7-465c-b5b7-6c39e64c3b1a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.205847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4ee0-04c7-465c-b5b7-6c39e64c3b1a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.211880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 209/413] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:17.213655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a801f2-0446-4208-af69-184248314ad1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.214486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a801f2-0446-4208-af69-184248314ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.214774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a801f2-0446-4208-af69-184248314ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.235747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-43a801f2-0446-4208-af69-184248314ad1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:17.237139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-43a801f2-0446-4208-af69-184248314ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:17.260209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fd377-d193-48e1-8c31-37ff3421390a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.317289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 210/414] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:17.345151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a801f2-0446-4208-af69-184248314ad1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.364940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.365829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.366108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.366385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.367653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.369132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.369701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.371630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 205/415] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.376964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.471295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.501772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a801f2-0446-4208-af69-184248314ad1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.544602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.545418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.545710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.545989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.555063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7075b-139d-4a07-9b4c-ed44841ffec4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.558412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:17.567661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:17.568615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:17.569816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 211/416] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:17.576274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.658146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.659018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.659303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.659580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.664804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.666269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.668832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 206/417] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:17.669430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.674288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.701835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f9e6-4a22-42a3-ae21-95efe6424402 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.741731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.742637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.742932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.743214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.743977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.744407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.746117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.758754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 212/418] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.765161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.881813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52336ce4-f39e-4c40-bfb4-6a66bead6ae7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.929166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2a62-83fe-4fdb-89a6-42bed5acf74d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.940449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.953451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.954107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.954392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.954669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.962000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.002530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a9b9-4f11-40af-a078-ab7998d6258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.003402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a9b9-4f11-40af-a078-ab7998d6258f None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.003689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a9b9-4f11-40af-a078-ab7998d6258f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.003968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a9b9-4f11-40af-a078-ab7998d6258f None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/groups/6a7b1809bf254102a5883a838c04b14e/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.012088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447a9b9-4f11-40af-a078-ab7998d6258f None admin] RBAC: Authorizing `identity:create_grant(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac, group_id=6a7b1809bf254102a5883a838c04b14e, role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.012088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447a9b9-4f11-40af-a078-ab7998d6258f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.039573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 207/419] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 14 10:40:17 2022] PUT /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac/groups/6a7b1809bf254102a5883a838c04b14e/roles/7607d90167e342db84bf7531c1ee5b29 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:40:18.047587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f589d7-ddbb-4caa-9be7-ff1002fe5ecd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.047969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f589d7-ddbb-4caa-9be7-ff1002fe5ecd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.048368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f589d7-ddbb-4caa-9be7-ff1002fe5ecd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.050016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 208/420] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:18.065630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.065932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.066202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.074831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.076564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.113128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:18.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:18.246817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 213/422] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:18.247335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 209/422] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:18.252484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.270530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.314607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.381994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.398995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9a60f-58fa-40f1-8826-8ff6b348c439 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.451923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.452824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.453111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.453389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.454717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.456186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.459856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3c34d-1705-45f3-9a9a-fceccf8423cf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.462793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 210/423] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:18.463660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.536528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.537366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.537703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.537980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.566700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:18.574806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:18.575679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:40:18.576486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:18.592297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 214/424] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:18.593216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.627144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef9c51-f508-4b8b-bdaf-5ba28a709631 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.668087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.668087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.668087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.668087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.668691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.670142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.672405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 211/425] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.677606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.748633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.777687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.785958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f256c6-1ecf-4c56-b79e-f147eb6700a9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.843334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.843928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.844240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.844522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.845282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.845596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.846969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.866252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0215-3616-4e2d-8fcc-787d6397ddbc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.868576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 215/426] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.880231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.918357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.919305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.919789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.920409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.921695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=d4dd7489edf94db982971ef1a23eaa17) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.922207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.924697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a8e8a-6d2d-4f22-b16f-1aaee90bd53d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.932338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 212/427] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 611 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.940239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41ee50-d0ec-49bc-9ec6-eb9e7c12898d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.940239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41ee50-d0ec-49bc-9ec6-eb9e7c12898d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.940239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41ee50-d0ec-49bc-9ec6-eb9e7c12898d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.940239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 213/428] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:18.945232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.945513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.945783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.963688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:18.964976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:19.083402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f5e84-bdf0-485f-8a4c-28dbaf61db32 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.103319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 214/429] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:19.138151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.145866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706143-0274-49ca-bab4-93992af91905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.146520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706143-0274-49ca-bab4-93992af91905 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.146800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706143-0274-49ca-bab4-93992af91905 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.147074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706143-0274-49ca-bab4-93992af91905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.178301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.179069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.239798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706143-0274-49ca-bab4-93992af91905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.241241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706143-0274-49ca-bab4-93992af91905 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.290200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31296-c5f2-4c40-a2c4-59cd440956a3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.335133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.335956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.336263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.336537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.348451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:19.360612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:19.361660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:19.362511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:19.363272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 215/430] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:19.370799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.372485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 216/431] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:19.377871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706143-0274-49ca-bab4-93992af91905 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.462126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.488913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.509262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706143-0274-49ca-bab4-93992af91905 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.509446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e47211-266e-41a9-a519-b181929ca269 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.557947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.559306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.559674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.559984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.560269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.560391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.560567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.560747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.561334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.561643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.562511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.563030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.563936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.566065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 217/432] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:19.573052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 216/433] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.574078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.581293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.713882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98a2b9-ce55-4ec2-889c-71b521209b0c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.722186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d50e-b317-4a65-a60d-c9a1ce68b1d8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.754043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.764316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.765133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.765515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.765801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.772457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649485-5efe-480c-8d5b-0dd98224deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.777586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649485-5efe-480c-8d5b-0dd98224deee None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.777895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649485-5efe-480c-8d5b-0dd98224deee None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.778176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649485-5efe-480c-8d5b-0dd98224deee None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.779467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649485-5efe-480c-8d5b-0dd98224deee None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.780954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649485-5efe-480c-8d5b-0dd98224deee None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.782889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 218/434] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.784139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774ae22-898a-4662-ac55-96b544214244 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.784428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774ae22-898a-4662-ac55-96b544214244 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.784703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774ae22-898a-4662-ac55-96b544214244 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.786201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 219/435] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:19.790303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774ae22-898a-4662-ac55-96b544214244 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.793089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.851149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.852647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.910748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774ae22-898a-4662-ac55-96b544214244 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.946752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.947408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.947960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.948301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.949137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=48fbdd1d59bf4d1482c26dc9539019f7, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.949474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.950878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ccf91-c632-4c22-b380-e3af4d2648a2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.956924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 220/436] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=48fbdd1d59bf4d1482c26dc9539019f7 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.956924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.956924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.956924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.981372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 217/437] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:19.986003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:19.987192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:19.987839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.041101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.048515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.066245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 221/438] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:20.094754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.106666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2af391-9220-4748-938e-32f73b09ac74 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.149196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.150098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.150422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.150665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] PATH_INFO: `/v3/projects/d4dd7489edf94db982971ef1a23eaa17` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.151917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] RBAC: Authorizing `identity:get_project(project_id=d4dd7489edf94db982971ef1a23eaa17)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.153985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.156907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 218/439] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/projects/d4dd7489edf94db982971ef1a23eaa17 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:20.162336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.230774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f46a5-f2d5-4748-ac7f-7bede7d43f38 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.270378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.271096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.271198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b46399-90db-4cf2-87d7-c9bf5e61ca2c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.271383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.271661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.282837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:20.288291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:20.290694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:20.291561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:20.292422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 222/440] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:20.297654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.313017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.313883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.314168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.314442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.315621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.317077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.318747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 219/441] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:20.325198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.355506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.409038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f891e38-10a4-4c12-9f11-6b4d62c098ad None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.427601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75f7a-335b-4c58-a8bd-88f10cdd7cf5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.443228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.443881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.444198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.444473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.445214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:20.445516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.446868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b00fe-d27d-40e3-a4ef-e80d62d3e63a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.454977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 223/442] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:20.456357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3665ba-66bb-42c7-8708-79e7e71084fc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.456645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3665ba-66bb-42c7-8708-79e7e71084fc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.456919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3665ba-66bb-42c7-8708-79e7e71084fc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.459030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 224/443] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:20.462505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3665ba-66bb-42c7-8708-79e7e71084fc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.464902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.465559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.465843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.466125 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.467058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=d4dd7489edf94db982971ef1a23eaa17) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:20.467403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.468895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc24b-3195-4939-9711-2a490ea31b72 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.474875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 220/444] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=d4dd7489edf94db982971ef1a23eaa17&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:20.476033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.476354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.476632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.500791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:20.502392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:20.553912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.579790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3665ba-66bb-42c7-8708-79e7e71084fc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.592099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 221/445] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:20.603789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.608756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.632050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.632725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.633013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.633291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.717091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.718566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.726481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0c3f-590d-4b61-9bfc-bb547c397205 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.768633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.772334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.772334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.772334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.783429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:20.793842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:20.794757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:20.795554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 222/446] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:20.801448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.832117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 225/447] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:20.837667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.849781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.851422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.930704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c844e-294d-4d9b-8026-01e5b794ac3d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.949033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd544a7f-a4df-49d4-b0e6-0732b2e32ad3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.970548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.971214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.971500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.971782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.972600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:20.972905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.974269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.984031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 223/448] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:20.989742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.992561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.993423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.993699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.993968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] PATH_INFO: `/v3/projects/2dceb4db085a4305881c3af4908bb6f8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.995673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] RBAC: Authorizing `identity:get_project(project_id=2dceb4db085a4305881c3af4908bb6f8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.997250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.999050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 226/449] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/projects/2dceb4db085a4305881c3af4908bb6f8 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:21.004329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.081364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.086250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.089673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3944778-b3f0-4557-bf97-4ed35856aee9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.104481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0718e-c376-4606-9e0c-2141e052c145 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.122724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.123363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.123643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.123915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.137852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.138699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.138985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.139263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] PATH_INFO: `/v3/groups/eb8cd57b58c6419f8d85f934b600d09c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.140473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] RBAC: Authorizing `identity:get_group(group_id=eb8cd57b58c6419f8d85f934b600d09c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.141912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.143528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 227/450] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/groups/eb8cd57b58c6419f8d85f934b600d09c => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:21.149125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.190173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.191631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.248187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158d077-ef17-4021-98df-d3ea5fce04e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.280148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.280785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.281063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.281333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.282246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] RBAC: Adding query filter params (group.id=eb8cd57b58c6419f8d85f934b600d09c, role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=2dceb4db085a4305881c3af4908bb6f8) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:21.282444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.283850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.285921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.289814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 228/451] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/role_assignments?group.id=eb8cd57b58c6419f8d85f934b600d09c&scope.project.id=2dceb4db085a4305881c3af4908bb6f8&role.id=195f05d542f14d7b93230878b428d9eb => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:21.302330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 224/452] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:21.308940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.322425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.412165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791faa03-35da-4448-8daf-5f853cfb05d1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.446159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.447020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.447306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.447581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] PATH_INFO: `/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.449592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] RBAC: Authorizing `identity:get_project(project_id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.451003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.452743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 229/453] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/projects/67f2d4e36bcf4cfeb9fb9ee33b4c98ac => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:21.458197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.554641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a083-c588-457d-806f-5491c2d4c7f7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.588550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e920e-08fd-44c9-a9d3-a29a314a423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.589393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e920e-08fd-44c9-a9d3-a29a314a423d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.589678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e920e-08fd-44c9-a9d3-a29a314a423d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.589956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e920e-08fd-44c9-a9d3-a29a314a423d None admin] PATH_INFO: `/v3/groups/6a7b1809bf254102a5883a838c04b14e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.591114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e920e-08fd-44c9-a9d3-a29a314a423d None admin] RBAC: Authorizing `identity:get_group(group_id=6a7b1809bf254102a5883a838c04b14e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.592572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e920e-08fd-44c9-a9d3-a29a314a423d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.594188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 225/454] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/groups/6a7b1809bf254102a5883a838c04b14e => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:21.599928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.676892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.697405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ffae-33cd-453a-9756-25be3dc0046e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.729632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.730271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.730557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.730834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.731665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] RBAC: Adding query filter params (group.id=6a7b1809bf254102a5883a838c04b14e, role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:21.731980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.733434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f65a7-bb07-4497-b844-d038ac3072d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.739056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 230/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/role_assignments?group.id=6a7b1809bf254102a5883a838c04b14e&scope.project.id=67f2d4e36bcf4cfeb9fb9ee33b4c98ac&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:24.477224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a359-e862-4fe1-9efa-f3e4141c9536 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.477770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a359-e862-4fe1-9efa-f3e4141c9536 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.477770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257a359-e862-4fe1-9efa-f3e4141c9536 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.479427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 226/456] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:24.485340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.486246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.486744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.509203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:24.510480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:24.581435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c15c6-d5f3-44f0-9ff5-3dcbd249f783 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.582063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c15c6-d5f3-44f0-9ff5-3dcbd249f783 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.582566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c15c6-d5f3-44f0-9ff5-3dcbd249f783 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.587840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 227/457] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:24.589825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b00e-4932-48f7-ad1f-5509701b1879 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.590334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b00e-4932-48f7-ad1f-5509701b1879 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.590804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b00e-4932-48f7-ad1f-5509701b1879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.600813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 231/458] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:24.621304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fe72b00e-4932-48f7-ad1f-5509701b1879 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:24.622906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe72b00e-4932-48f7-ad1f-5509701b1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:24.678644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.705266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.712336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 228/459] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:24.714729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ad2ac-eee3-4543-b39a-5e9f3f09dd70 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.715166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ad2ac-eee3-4543-b39a-5e9f3f09dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.715586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ad2ac-eee3-4543-b39a-5e9f3f09dd70 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.717317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 229/460] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:24.728159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.728159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.728159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.754098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:24.755278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:24.756638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.793495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e08dd0-b9fb-4c1d-a06e-5390037610f5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.830914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.831939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.832403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.832927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.843973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.845618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.848132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 230/461] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:24.849134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:24.889630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:24.890721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:24.891616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:24.891616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:24.891616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:24.891616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:24.893671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 232/462] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:24.894486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.990076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d421-cba4-4f23-8677-2c69942a6c63 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.010086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd28cb-29d5-40d8-9239-d646380d581b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.020180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.030132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.031186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.031658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.032142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.041062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.045901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.048140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.054787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.055991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.056308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.056587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:25.066695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.067509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.068756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:25.068756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:25.068756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.068756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:25.069326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.069397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 231/463] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:25.069397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.070952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-16653eef-92c3-4a23-a128-4192a4912ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:25.092165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.093066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.093893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:25.093893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:25.093893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.093893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:25.093893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 233/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:25.095092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca98e61-c3b7-43e6-8d53-f5c5666eb2cb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.095092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca98e61-c3b7-43e6-8d53-f5c5666eb2cb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.095301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca98e61-c3b7-43e6-8d53-f5c5666eb2cb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.096764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 234/465] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:25.100951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca98e61-c3b7-43e6-8d53-f5c5666eb2cb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.181358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1022-7e20-487b-8ef7-5517e94546c9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.204504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca98e61-c3b7-43e6-8d53-f5c5666eb2cb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.218722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.219376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.219654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.219925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.220674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.221094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.222547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.234612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 232/466] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:25.235411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.242949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.243546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.243834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.244135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.245466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.245791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.247196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4e8f3-a561-42ce-8d68-ed8532c69634 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.259472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 235/467] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:25.261104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.261391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.261667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.279314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:25.280545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:25.281812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.312426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.345179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa6b17-a403-425c-8862-15ec35f66270 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.360100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 236/468] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:25.360100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.388343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.389044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.389304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.389584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.390315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.390618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.391986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.404399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 233/469] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:25.405181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.482196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191eb0-c173-45a9-81b3-edddd977aa85 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.503453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.507495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510f098-cb49-402b-99b5-983bcd4eecaa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.520623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.521455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.522102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.522386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.523373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.525270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.543117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.543962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.544289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.544560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.545326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.546776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.549604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 237/470] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:25.550792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.576132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 234/471] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:25.576132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.614356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.722074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e6b5a-bd7c-4048-bf26-20ecafe317f7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.730631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b89f1-adad-4857-a8af-fc980e79a42c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.765491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb31dd-405e-4f80-b473-57b9a4709c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.766401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb31dd-405e-4f80-b473-57b9a4709c7b None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.766822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb31dd-405e-4f80-b473-57b9a4709c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.767243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb31dd-405e-4f80-b473-57b9a4709c7b None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.767961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb31dd-405e-4f80-b473-57b9a4709c7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.769457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb31dd-405e-4f80-b473-57b9a4709c7b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.771390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.772239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.772526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.772800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.786013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.788412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.796472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 235/472] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:25.797873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276573d-7c7c-40ea-9350-239eb188423f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.798161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276573d-7c7c-40ea-9350-239eb188423f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.798444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276573d-7c7c-40ea-9350-239eb188423f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.800789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 236/473] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:25.805385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978168-b140-48b1-b56c-680c4029602d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.805753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978168-b140-48b1-b56c-680c4029602d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.806036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978168-b140-48b1-b56c-680c4029602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:25.809203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.810028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.810864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:25.810864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:25.810864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.810864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:25.810864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 238/474] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:25.818673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.826362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-da978168-b140-48b1-b56c-680c4029602d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:25.827619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da978168-b140-48b1-b56c-680c4029602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:25.837479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.927017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.929416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 237/475] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:25.952818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da978168-b140-48b1-b56c-680c4029602d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.980174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468930-23de-4a0f-beea-796b99a41b1c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.028112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.028676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.028956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.029235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.030160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:26.030588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.032000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.052091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 239/476] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:26.054497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.101101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da978168-b140-48b1-b56c-680c4029602d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.139274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.140315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.140843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.141407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.142380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.144030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.152890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.sql.core [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:40:26.152890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 10:40:26.152890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [parameters: {'id': '363f6a3a74d34ac99beb9d94f84133c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 10:40:26.152890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80168) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:40:26.162013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fd724-ccb2-4cf4-89c2-cac8625b0cfa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Jul 14 10:40:26.171467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:40:26.172610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application yield resource Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise self.value Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application session.commit() Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:40:26.173727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:40:26.174770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:40:26.175877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:40:26.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [parameters: {'id': '363f6a3a74d34ac99beb9d94f84133c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:26.177896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 10:40:26.178886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:26.181393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 238/477] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:26.186708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.200315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.214354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.215349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.215924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.216368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.217284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.218910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.230373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.250904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 240/478] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:26 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:26.330463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbbbe4-ae3b-434d-9d0a-f40f69690c6a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.372438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf6c84-423e-4569-9b81-7619eb9c5771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.373271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf6c84-423e-4569-9b81-7619eb9c5771 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.373616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf6c84-423e-4569-9b81-7619eb9c5771 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.373900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf6c84-423e-4569-9b81-7619eb9c5771 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.385963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf6c84-423e-4569-9b81-7619eb9c5771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8baf6c84-423e-4569-9b81-7619eb9c5771 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:26.394585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:26.395716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:26.396824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 239/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:26.405219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.545312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248b88-3fea-4dfa-a5be-3f3cb3b52a20 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.587548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.588210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.588494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.588873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.589626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:26.589933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.591297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab84d6-07cc-49c5-9ccc-468a44fe04d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.599680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 241/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:28.035866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ecf3-9113-49fe-a20b-a5b4537d368d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.036510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ecf3-9113-49fe-a20b-a5b4537d368d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.036510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ecf3-9113-49fe-a20b-a5b4537d368d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.038101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 240/481] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:28.043782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1c2d6-5f60-47e4-92e1-ae73484d39af None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.044212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1c2d6-5f60-47e4-92e1-ae73484d39af None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.044417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1c2d6-5f60-47e4-92e1-ae73484d39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.061472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-28d1c2d6-5f60-47e4-92e1-ae73484d39af None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:28.062672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-28d1c2d6-5f60-47e4-92e1-ae73484d39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:28.112192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.137084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 242/482] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:28.159967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ecf3-9113-49fe-a20b-a5b4537d368d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.254469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.305951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7776300-a36b-49cf-8e74-5b1e8f6ec93c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.306243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7776300-a36b-49cf-8e74-5b1e8f6ec93c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.306521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7776300-a36b-49cf-8e74-5b1e8f6ec93c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.308841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 243/483] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:28.311057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247ecf3-9113-49fe-a20b-a5b4537d368d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.327671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.328252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.328741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.354183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:28.355694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.356253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:28.356614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.356905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.357184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.373668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:28.390120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:28.391030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:28.392452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 241/484] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:28.398525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.430108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 244/485] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:28.454629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.561065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee6785-5859-438d-8478-825ee799bf3f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.589064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.595536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e72fc-3ba9-4fe5-b41d-822f00176c2b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.600168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.600930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.601294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.601697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.602803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:28.603186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:28.606179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bcb35-e3b4-4bcb-8671-de4c5f26d180 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:28.611596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.619974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 242/486] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:28.626304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59edd5-c047-492b-95d5-61466a0d8a4a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.627375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59edd5-c047-492b-95d5-61466a0d8a4a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.628024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59edd5-c047-492b-95d5-61466a0d8a4a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.630550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 243/487] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:28.631571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59edd5-c047-492b-95d5-61466a0d8a4a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.641418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030a29b-197b-4767-acc6-baa3f336760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.642149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030a29b-197b-4767-acc6-baa3f336760e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.642429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030a29b-197b-4767-acc6-baa3f336760e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.642701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030a29b-197b-4767-acc6-baa3f336760e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.656653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030a29b-197b-4767-acc6-baa3f336760e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a030a29b-197b-4767-acc6-baa3f336760e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:28.668616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:28.669480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:28.670271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:28.672140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 245/488] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:28.673613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.674160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.674702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.692023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:28.693550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:28.754898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59edd5-c047-492b-95d5-61466a0d8a4a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.765856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 246/489] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:28.767006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.814170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.814951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.815232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.815504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.828901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:28.830369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:28.847933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:28.848982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:28.849810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:28.849810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:28.849810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:28.849810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:28.853735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 244/490] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:28.855115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.879390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca67c-af76-403a-aa08-fac542e92779 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.881668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.900768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.924937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.925726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.926011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.926289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.927037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:28.927352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:28.928885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:28.937742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 247/491] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:28.938373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.966952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794dd5c-d308-496b-b804-4cc19821be0c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.003070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c5bd1-6fc8-4cc1-b9fa-4f7cf24e4c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.004020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5bd1-6fc8-4cc1-b9fa-4f7cf24e4c7d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.004455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5bd1-6fc8-4cc1-b9fa-4f7cf24e4c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.004732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5bd1-6fc8-4cc1-b9fa-4f7cf24e4c7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.015704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c5bd1-6fc8-4cc1-b9fa-4f7cf24e4c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-045c5bd1-6fc8-4cc1-b9fa-4f7cf24e4c7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:29.024160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.025056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:29.025855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 245/492] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.027511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571c7f-6fea-459a-853a-387c1a3eae49 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.027780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571c7f-6fea-459a-853a-387c1a3eae49 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.028109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571c7f-6fea-459a-853a-387c1a3eae49 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.029488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 246/493] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:29.031219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571c7f-6fea-459a-853a-387c1a3eae49 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.048827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01c6f8-1c76-4a9c-92e0-792f89046c7e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.085185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.085836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.086116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.086387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.087104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.087405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.089293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.101481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 248/494] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.106923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.137919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.140189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.145765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571c7f-6fea-459a-853a-387c1a3eae49 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.183276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.184110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.184515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.184723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.195904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.197382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1bb62c23-ab77-46f6-b3fd-418632a80119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:29.215637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.216489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.217322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:29.217322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:29.217322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:29.217322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:29.217322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 247/495] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.218123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.218309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.218587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.226015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bf9d-da9d-4424-8513-ac050e4b61e5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.234907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:29.236137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:29.264108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.264780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.265302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.265407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.266114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.266427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.267790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.276385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 249/496] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.277189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.309011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 248/497] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:29.309739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.377393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.392418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.392738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d4b09-49d5-4010-95e1-a5a3fed8f380 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.409841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52785f6-57c1-48c5-b2ec-b10d363ad17a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.426899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.427689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.427973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.428297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.436770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.438148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.444422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.445085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.445371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.445651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.446367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.446677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.448813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51525df4-7b60-4c88-a0d2-6a54aa8e3819 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:29.453963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.454835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 250/498] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.455942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.466597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 249/499] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.466597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df783c4-2e0c-443f-bf22-bfd8ef16570c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.466597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df783c4-2e0c-443f-bf22-bfd8ef16570c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.466597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df783c4-2e0c-443f-bf22-bfd8ef16570c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.466597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 250/500] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:29.466597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df783c4-2e0c-443f-bf22-bfd8ef16570c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.557240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c9201-e806-412f-b059-e6f73d0a72fd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.566298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df783c4-2e0c-443f-bf22-bfd8ef16570c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.590538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.591316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.591605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.591883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.598571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.599340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.599620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.599893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.602345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.603798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.610214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:29.610603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:29.617809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.618689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:29.619510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 251/501] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.620430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:29.622375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.623346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.624402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:29.624402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:29.624402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:29.624402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:29.624402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 251/502] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.624747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.631385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.721308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7484b3-b8a0-4cc4-9ae4-6c65445e0a0b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.727308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04ddb-28ac-47a6-9f16-9938363c1805 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.754267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.755042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.755332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.755609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.759812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.760549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.760836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.761114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.761946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.762260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.763088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.763688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.764566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4fcf73a8-f6e5-48a8-8ee4-7271da5e2105 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:29.778942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.779981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:29.781118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 252/503] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.781746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.781746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.781972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.798432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:29.799633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:29.800831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 252/504] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.801656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.851420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.861263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.866702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 253/505] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:29.867533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.908535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969d7b7-c2e0-4785-96c8-1d31cba450a4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.941772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.942428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.942714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.942994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.943746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.944053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.945460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.954479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 253/506] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.955270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.969155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515d4b-96c4-4f6e-93ba-4c776dae96a6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.003261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.003849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.004170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.004453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.005179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.005491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.006850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.018255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 254/507] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.019023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.053402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e926-424f-4d78-94cc-59136a1d4035 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.066385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.076199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.088355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.089045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.089327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.089601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.090427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.090737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.092186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.109423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 254/508] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.110208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.120273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5639a9-6c61-47d4-bab8-b28d3b7a1413 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.153279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.153923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.154212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.154496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.206449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbd14-e627-4c18-94d6-dabab050b29a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.219927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.221409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.240097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.240886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.241171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.241448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.251831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.253442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.268537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:30.270744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.271581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.272455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:30.272455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:30.272455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.272455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:30.272455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 255/509] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:30.273111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.308411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.328479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 255/510] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:30.329515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.379684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c9f4d-5d61-4eb9-ad4e-97241d5a6c73 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.412360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.413149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.413852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.414146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.425074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859b547-d82b-48cd-beed-8f7cc82f7dcb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.425201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.426616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:30.444023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.444945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.445780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:30.445780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:30.445780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.445780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:30.445780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 256/511] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:30.446034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.459861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.460682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.460964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.461236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.468295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.469729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:30.483939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.485109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 256/512] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:30.486216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.497062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.532425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.550970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3151a35-b7ec-4c5c-832b-baa88b1dd0f5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.583808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.584485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.584770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.585052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.586022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa940e6-430e-4acd-94da-72c3eb491d32 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.621162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.621812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.622099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.622379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.623096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.623411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.624798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.635826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 257/513] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.636743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.654234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.655782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.703503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.737518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4f6d-b259-4a9d-bdbe-aefcd9daafbb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.738375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.755818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 257/514] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:30.756744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.774527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.775319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.775605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.775885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.786454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.787876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:30.804590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.805594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.806474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:30.806474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:30.806474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.806474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:30.806474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 258/515] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:30.806809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.856351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275607d9-aa2f-4475-b2d2-f006dd1ffbcd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.890063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.890722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.891004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.891281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.891997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.892338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.893713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.904598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 258/516] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.905353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.910671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2d24-36f1-48fb-ab0f-8187bd0a25a3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.930906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.946107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.946772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.947060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.947341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.949012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.949326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.950335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.950994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.987326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 259/517] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.988177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.004195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35c058-0a6a-449d-b481-b57da2e7967b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.037526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.038155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.038438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.038720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.039419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.040868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.060267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 259/518] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:30 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:31.061058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.105429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e66d3-8b3e-44b3-8219-dd915d3ae829 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.145359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.146262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.146545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.146818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.164220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.166054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.179013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.181974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a884f-bfe1-4ff7-a37f-13dbf85f8e5b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:31.190559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:31.191676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:31.192857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:31.192857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:31.192857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:31.192857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:31.192857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 260/519] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:31.193629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.227879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.228458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.228620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.228910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.229192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.230017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:31.230442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.231814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.246121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 260/520] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:31.246958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.306826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68044f-581c-43df-b33c-1a4de5052386 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.342309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.343101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.343387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.343675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.351278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.352758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.356870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bafc38-fd44-4daf-beb5-ffda4fe67dca None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:31.367319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:31.368435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:31.369348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 261/521] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:31.370457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.399470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.400488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.401045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.401463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.431652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.466378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.480680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcadf-0b71-42e2-99e5-eb271b4a10d2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.481072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.482624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.525553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.526957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.527314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.527665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.528491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:31.528871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.530325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.543211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 262/522] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:31.544175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.590090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 261/523] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:31.591217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.648916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.661642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531d3c-eb2e-4dd4-863c-cb7b65347e71 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.689049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495441b0-0082-42b2-b0f6-291a3626a121 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.697403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.699146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.699496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.699949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.707177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.708646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.722472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e446e-c525-44df-a993-0f0045459afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.723207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e446e-c525-44df-a993-0f0045459afe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.723553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e446e-c525-44df-a993-0f0045459afe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.723892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e446e-c525-44df-a993-0f0045459afe None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.724823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e446e-c525-44df-a993-0f0045459afe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:31.725188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:31.726321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:31.727354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:31.727843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e446e-c525-44df-a993-0f0045459afe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.727923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 263/524] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:31.727923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.728294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e446e-c525-44df-a993-0f0045459afe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.741616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.752573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 262/525] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:31.752573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e446e-c525-44df-a993-0f0045459afe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.842086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c9dc-03b4-458d-b4bd-61770947c042 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.852880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e446e-c525-44df-a993-0f0045459afe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.875921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:31.883681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.884502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.884781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.885053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.892169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.893584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.895837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.896666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.896953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.897235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:31.907261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:31.908195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:31.914063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:31.914574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.914656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 264/526] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:31.914733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.914819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:31.931842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:31.932809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:31.933635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:31.933635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:31.933635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:31.933635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:31.933635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 263/527] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:31.933995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.992523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.026605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d40602-8530-4ad9-9c5a-d22c9b593575 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.037956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265126db-db58-44ba-95e9-e8f47346e621 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.061229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.061884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.062169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.062449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.063237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.063549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.065097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.075241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.075885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.076665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.076969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.087909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 265/528] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.087909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.125238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.156921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.158379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.184263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab0647-02ab-4762-abd2-76b15a0ffcb1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.215047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.221576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.222238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.222547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.222805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.223597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.223905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.225367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.236928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 266/529] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.237734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.269586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 264/530] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:32.270440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.353073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.355954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5123ee0-da69-4543-b47f-c486969b4c07 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.383881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9564ca-a8b5-47f8-90a4-aed1fb917202 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.397624 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.398679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.399204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.399491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.400408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.400728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.402448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.421205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 267/531] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.421205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.422388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.423052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.423337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.423612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.424466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=eb4489f887f944f0806b63b669ffb883) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.424834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.426262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.440102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 265/532] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/role_assignments?user.id=eb4489f887f944f0806b63b669ffb883&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.440102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.474727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.542763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0d314-a0d4-4767-9435-361f85d743e5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.571106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb0cc-0cdf-47c9-984c-1656414704b7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.585281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.586425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.587024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.587558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.588734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=11d05026ac51451a8c10fb63f840d15f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.589262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.591119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.603095 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 268/533] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/role_assignments?user.id=11d05026ac51451a8c10fb63f840d15f&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.605135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.611128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.611931 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.612248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.612526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.614709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.625384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.627088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:32.647012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:32.647921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:32.648814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:32.648814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:32.648814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:32.648814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:32.648814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 266/534] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:32.661603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.814220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c6cd9-efc8-40a7-acd2-ff33e696177c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.815920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287b19-e77c-463c-b5fb-8c69223df80a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.830134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.853962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.855243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.855526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.855801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.859020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.859764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.860144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.863226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.863226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.863226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.863226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.863532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.864700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.878111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 267/535] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:32.880974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:32.881786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:32.882642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 269/536] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:32.883672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.893048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.952484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.003164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573c823-8023-4875-9f71-67ddf7f776cb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.047970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727665e9-d01d-48e4-97a8-e6ea3d4b4968 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.053118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.054298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.054576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.054850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.055633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.055938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.057940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.078301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 270/537] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:33.083468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.115283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.116471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.117130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.118786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.133351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.135161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:33.155807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:33.156704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:33.157608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:33.168907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 268/538] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:33.171945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.177057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.287622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a7a68-972e-4ba4-a23c-f3dcf958232f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.296196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.320852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077e58-4153-4c8e-b5fd-4aa325bb30bb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.326065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.326850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.327234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.327608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.328538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.328946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.330601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5b343-0dbd-469d-b574-c3996f32e56e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.353538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 269/539] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:33.356593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad02bd-c7f0-4aa4-aefb-ebc283a60704 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.356996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad02bd-c7f0-4aa4-aefb-ebc283a60704 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.357494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad02bd-c7f0-4aa4-aefb-ebc283a60704 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.362963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 270/540] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:33.362963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad02bd-c7f0-4aa4-aefb-ebc283a60704 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.366032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.366910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.367348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.367776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.368823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=b7de00325c784e79be24c9928dd535e5) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.369561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.374005 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eaf38-1b8c-4e56-9730-0f51dac490ab None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.384368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 271/541] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/role_assignments?user.id=b7de00325c784e79be24c9928dd535e5&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:33.385588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.385879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.386157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.410582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:33.412148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:33.483504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad02bd-c7f0-4aa4-aefb-ebc283a60704 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.516276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 272/542] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:33.537371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.553648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.554244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.554526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.554797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.558042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=1f86dd9b76ef42e8a6fbff301df7d3b8) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.558391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.560962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.584166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 271/543] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/role_assignments?user.id=1f86dd9b76ef42e8a6fbff301df7d3b8&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:33.590517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.703079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8bd78-488b-4fe0-af3c-1e280c958aa1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.749843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.750666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.750948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.751222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.765587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:33.773527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:33.774371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:33.775568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 273/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:33.782767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.825138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.913975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd41981-b6c3-4944-b6cd-c95d6147e508 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.949552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.950223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.950507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.950784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.951532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.951842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.953250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.961971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 272/545] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:33.967699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.089421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.104976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cab941-3a7b-41be-bc5c-34b437a5f051 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.148943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.149746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.150029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.150310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.165252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.167238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:34.193216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:34.194080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:34.195303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:34.195303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:34.195303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:34.195303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:34.195303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 274/546] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:34.202073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.400811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.415601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb401-bba3-4318-8f2d-fe134384bfa5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.450820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.451547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.451833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.452132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.452913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:34.453225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.454590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.467146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 273/547] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:34.472651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.624318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cc9d4-b262-42b8-9d2f-fd9208689323 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.675908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.676804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.677090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.677366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.690923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.692397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.696083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:34.718437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:34.719376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:34.721433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 275/548] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:34.725677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.829225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7239d-48a9-45fb-9a5a-f1499f77809a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.863735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.864507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.864792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.865724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.865950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:34.866262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.867736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fa077-89df-4251-8f14-dfd322e41af8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.886877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 274/549] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:34.893138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.038509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50338-28d8-4aeb-b7e4-78f767099062 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.091321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.091979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.092296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.092569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.144527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d9c1-da29-4746-bdb1-5443722ae1fc None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.144813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d9c1-da29-4746-bdb1-5443722ae1fc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.145084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357d9c1-da29-4746-bdb1-5443722ae1fc None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.146698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 275/550] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:35.152459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9d91-a4f1-4f9e-800f-57ac24d49854 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.152748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9d91-a4f1-4f9e-800f-57ac24d49854 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.153031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df9d91-a4f1-4f9e-800f-57ac24d49854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.171430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d2df9d91-a4f1-4f9e-800f-57ac24d49854 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:35.172875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d2df9d91-a4f1-4f9e-800f-57ac24d49854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:35.175729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.179127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.182063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.185344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.249819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 276/551] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:35.257677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d6cbd-885d-4a3d-a449-a420f80878d8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.258159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d6cbd-885d-4a3d-a449-a420f80878d8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.258620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d6cbd-885d-4a3d-a449-a420f80878d8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.260448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 277/552] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:35.266518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.266993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.267483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.289390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 276/553] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:35.296331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.297957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:35.299160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:35.371428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 278/554] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:35.372369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.423430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.427531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a496-8362-4438-810c-7a23c39989f6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.464433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.465791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.466277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.466752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.477825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:35.484455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:35.487442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:35.488819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:35.490136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:35.496271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0754-ae73-4cd8-983b-29d1a1715d71 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.496540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 277/555] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:35.497619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.542376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.543103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.543390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.543672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.561779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.563505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:35.588435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:35.589966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:35.590801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:35.590801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:35.590801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:35.590801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:35.593387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 279/556] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:35.593387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.625712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7b7f7-535c-43ac-bcf3-75ffe4547025 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.673527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.674329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.674617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.674897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.689208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:35.700804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:35.701692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:35.703499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 278/557] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:35.705225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.705375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbcd4-4dd2-43b4-bae2-26d1b937d5de None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.733203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.736399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.748286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.748922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.749214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.749506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.750253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.750563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.751929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.762098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 280/558] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:35.763232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.835957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c50e2-cde7-44a8-9440-e19b8ed133f7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.876120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb79782-a947-404e-83da-e47a043f5c23 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.880368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.881241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.881770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.882132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.882943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.883324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.884808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.898339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 279/559] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:35.899150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.917371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.918096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.918392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.918672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.919424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.919733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.921140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ad32d-fe94-4585-a209-5c02fdb5cdaf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.929953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 281/560] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:35.931194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fc4e5-23c5-46a6-b79d-1e8e8d94c558 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.931501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fc4e5-23c5-46a6-b79d-1e8e8d94c558 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.931770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fc4e5-23c5-46a6-b79d-1e8e8d94c558 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.936201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 282/561] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:35.936201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fc4e5-23c5-46a6-b79d-1e8e8d94c558 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.986801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.987353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.007229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100039-dc65-4fd1-b35d-41f0444d7460 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.040078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.040289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fc4e5-23c5-46a6-b79d-1e8e8d94c558 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.040875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.041167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.041445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.051226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.052691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:36.070981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.071901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.073905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:36.073905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:36.073905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:36.073905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:36.073905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 280/562] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.073905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.074705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.075510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.075788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.076095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.082972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.084438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-22f94324-c384-4668-81b3-f24ad4ff0aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:36.098615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.099535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:36.100434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 283/563] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.101132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b00cb2-66cd-4a90-ad91-73245cf3bcf2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.101201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b00cb2-66cd-4a90-ad91-73245cf3bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.101434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b00cb2-66cd-4a90-ad91-73245cf3bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.119576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-12b00cb2-66cd-4a90-ad91-73245cf3bcf2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:36.121363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-12b00cb2-66cd-4a90-ad91-73245cf3bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:36.174864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f119d02-f79e-4e6f-98be-544edad4984b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.187451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 284/564] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:36.188776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcb83-5b77-473f-8c61-0ba173a7b165 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.189069 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcb83-5b77-473f-8c61-0ba173a7b165 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.189349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bcb83-5b77-473f-8c61-0ba173a7b165 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.190856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 285/565] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:36.191554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bcb83-5b77-473f-8c61-0ba173a7b165 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.206208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.212625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.213482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.213845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.214118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.224080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.225508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.227433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:36.243387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.244497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.245462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:36.245462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:36.245462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:36.245462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:36.245462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 281/566] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.245823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.294269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bcb83-5b77-473f-8c61-0ba173a7b165 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.329470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.330146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.330430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.330708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.331423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.331731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.333154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2807271-86c7-43fe-96a8-870b97644ae8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.345045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 286/567] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.346313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.346601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.346880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.347578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1c80-de83-46b0-b40c-7c31016a9c8d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.362519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:36.363616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:36.379955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.380658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.380928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.381201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.381981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.382287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.383696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.395735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 282/568] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.396593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.432833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 287/569] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:36.433664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.451028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.460972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.503625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adde94-01b5-4d3d-9cbf-cd74a75ae60e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.533206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790981a-a04e-408f-85cf-f1047963af40 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.536099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.536882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.537160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.537427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.547533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:36.555134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.556291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 283/570] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.557757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.570102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.570756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.571037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.571312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.572022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.572357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.574039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.585893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 288/571] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.586668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.656730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50b7be-4227-4402-b9c5-2864b30595c3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.659606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.673771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.689131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f5f0e-f83b-409d-b641-4ff6abaef7a8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.691857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.692672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.692958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.693235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.701031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.702472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:36.717399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.718544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:36.719689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 284/572] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.720516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.725307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.725971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.726256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.726534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.727374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=eac24ebb573140718662633d85735b71) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.727691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.729160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.734845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 289/573] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/role_assignments?user.id=eac24ebb573140718662633d85735b71&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.735521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.831094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ee7a-b789-4135-a473-d5ce7fc3952a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.874492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.875245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bef82c-063e-4fe2-8f72-18ef51c2173d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.875576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.875960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.876364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.891202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:36.898697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.899717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 285/574] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.901008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.915023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.924090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.924090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.924090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.924090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.924090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.924090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.928266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.933216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 290/575] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.934083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.949986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.005604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c86d47-5d7a-4c5b-bb64-6e7c541265cc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.043896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.044703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.044985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.045260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.045545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2adb5-7960-4158-83fc-0eebe6d0d8a5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.053367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.055088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:37.069806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:37.070753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:37.071665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 286/576] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:37.072266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.086822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.087492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.087777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.088054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.088966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:37.089276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.090684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.112999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 291/577] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:37.112999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.169287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.184093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.190494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f267-6c5c-43fb-92c7-d83ddae376d2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.217168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa662cc3-ef59-4052-a0de-79fe4afb8062 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.231470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.232224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.232457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.232735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.233484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:37.233794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.235149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.243648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 287/578] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:37.244272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.255812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.256630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.256916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.257200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.267802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.269313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:37.289645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:37.290542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:37.291411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:37.291411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:37.291411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.291411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:37.291411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 292/579] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:37.291774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.354731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b81af-a4d4-495d-8f4f-47fce8389288 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.390505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b94b35-c5a3-453c-a304-6dea953556ca None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.392109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.393133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.393486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.393769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.394609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:37.394924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.396374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.413337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.420418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 288/580] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:37.420418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.425569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.433886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.435007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.435460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.435748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.446142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.447584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:37.466327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:37.467357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:37.468979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:37.468979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:37.468979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.468979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:37.468979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 293/581] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:37.468979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.529209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477988c6-d79c-4bc0-8eeb-add394b66a4f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.570189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.570967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.571247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.571525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.574683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b0464-bb37-4ec9-bae9-c6d4d5a40017 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.581976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.583401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:37.601073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:37.602125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:37.602982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:37.602982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:37.602982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.602982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:37.602982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 289/582] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:37.603258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.615404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.616088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.616386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.616663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.617381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:37.617684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.619040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.632213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 294/583] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:37.633107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.669799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.671893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.723402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d9a1-bbd6-4e61-990e-11f55bfd866d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.740844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3bb7-9413-47b6-b04f-b011f5183e84 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.759216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.760161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.761135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.761511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.772767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.774302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.776388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.777054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.777336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.777614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.778327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:37.778632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.779975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:37.792586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:37.794100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:37.796272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:37.796272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:37.796272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:37.796272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:37.796776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 295/584] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:37.796776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.801235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 290/585] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:37.801235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.898175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.905937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d434f-63c4-4bf3-a246-7aa5c7cc302f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.918568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b9299-8c94-4b7c-8ee9-3a8ec0d05330 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:37.928025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:37.942217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.942925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.943205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.943504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.944254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:37.944562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.945926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.957512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:37.961934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 296/586] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:37.962061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.962061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.962239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:37.962327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.970231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:37.971909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:37.987110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:37.988265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:37.989340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 291/587] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:37.990084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.071760 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da058c-a566-4269-9192-03d7caa5ae73 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.100317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b42a52-f16a-4bdd-89ee-9b76796ef904 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.107708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.108539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.108827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.109101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.116456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.117921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:38.132683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.133541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:38.134422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 297/588] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:38.134990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.138200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.138854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.139135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.139407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.140154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.140461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.141831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.153944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.154379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 292/589] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:38.155234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.190115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.251825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cda81f-6afd-433e-9c03-220a2ef61a11 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.272028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a02b4-4674-4c5b-8ec5-f44bd26100ae None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.289207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.290119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.290506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.290788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.298919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.300520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.307816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.308644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.308928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.309201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.310043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.310354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.311774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:38.318590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.319514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 298/590] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:38.320845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.339100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 293/591] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:38.339100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.405823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.423010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.434307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5e28-e3af-4843-9e6a-602eba52bddc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.439375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3281c05-fbc6-434c-92fc-519ab402cfa4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.469145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.469737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.470023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.470301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.471087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.471399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.473033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.485156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 299/592] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:38.485942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.494157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.495729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.496188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.496634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.504011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.505607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:38.519209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.520255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:38.521105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:38.521531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 294/593] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:38.522279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.600075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3237f2-32a8-4e45-84ee-3fb26d56cb4a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.629636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56c07d-b73d-47f1-a769-ab8550c22d6a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.637155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.638104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.638613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.639112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.640170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.640685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.642252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.644589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.664737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.665523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.665801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.666075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.667216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 300/594] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:38.668121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.677492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.678936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.685642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:38.696947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.698595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.699440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:38.699440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:38.699440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:38.699440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:38.699440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 295/595] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:38.699714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590f4e0-9c7a-44d1-9743-a43347fa64fd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.808118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299b57-12b4-493d-879d-82c424d1dc91 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.834436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.835317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.835595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.835867 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/eb4489f887f944f0806b63b669ffb883/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.841850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.842502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.842788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.843074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.843861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.844210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.845640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.850632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=eb4489f887f944f0806b63b669ffb883, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.852050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.858506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 296/596] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:38.859306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.868182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 301/597] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:38 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/eb4489f887f944f0806b63b669ffb883/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:38.869133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.920295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.940365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.985528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b621b-0d30-486e-b9d7-423f7a0bba95 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.996649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa47b-58bf-4b8f-9809-d1331b66a757 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.027620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.028374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.029055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.029055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.029648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.029955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.031313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205820-6e87-46ee-9de4-29fdf7ad16ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.040128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.041215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.042243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.042721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.043224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 302/598] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.044595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a58533-bb6d-44d4-a27d-98b41a70b83b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.044884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a58533-bb6d-44d4-a27d-98b41a70b83b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.045155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a58533-bb6d-44d4-a27d-98b41a70b83b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.049756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 303/599] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:39.049756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a58533-bb6d-44d4-a27d-98b41a70b83b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.061809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.063749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:39.085453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.086567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.087674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:39.087674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:39.087674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:39.087674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:39.089812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 297/600] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.090718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.159163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a58533-bb6d-44d4-a27d-98b41a70b83b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.160746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.197702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9906c-f687-4a4e-9ca1-56338ed233fc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.198441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432f4d1-3fbc-4710-8534-ad81b50604c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.199331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f4d1-3fbc-4710-8534-ad81b50604c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.199615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f4d1-3fbc-4710-8534-ad81b50604c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.199893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f4d1-3fbc-4710-8534-ad81b50604c4 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/11d05026ac51451a8c10fb63f840d15f/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.209526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.216349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432f4d1-3fbc-4710-8534-ad81b50604c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=11d05026ac51451a8c10fb63f840d15f, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.217802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432f4d1-3fbc-4710-8534-ad81b50604c4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.238155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 304/601] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:39 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/11d05026ac51451a8c10fb63f840d15f/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:39.238155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.238155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.238155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.250890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.251937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.252278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.252559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.256849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:39.258190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:39.261481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.263183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:39.280627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.281604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:39.282450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 298/602] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.283127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.360691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 305/603] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:39.361597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.414451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428376-1cea-4580-ab16-4759194b45a6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.460254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.461123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.461587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.462069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.463019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.463360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.464940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.469528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.477897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 299/604] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.478801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.499558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d153171-3e50-4139-a68e-48c5db13bc45 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.535775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.538798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.540110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.540400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.540677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.541505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.541822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.543356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.560388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 306/605] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.561374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.595961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1a402-7644-4762-8894-92fc68f62eaa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.633015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.633783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.634069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.634347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.645803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:39.654190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.655100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 300/606] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.656789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.678214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcd790-d6d3-4ef8-b7cc-03165b5f8fe6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.715030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.715926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.716239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.716611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.723759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.725282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:39.740720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.742732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:39.744954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:39.751040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 307/607] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.751040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.751040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.752745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.764311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1016-0642-4d3b-8af9-d69151e5e40e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.801972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.803101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.803485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.803915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/b7de00325c784e79be24c9928dd535e5/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.824551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=b7de00325c784e79be24c9928dd535e5, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.826440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.851472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 301/608] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:39 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/b7de00325c784e79be24c9928dd535e5/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:39.851472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.888690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb4b6-01de-46fe-81f2-e4913d2d4fe6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.977285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7173a6b-05a6-42f9-8893-3e3e881f0583 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.992886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.993998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.994485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.995040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.996016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.996569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.998150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.009380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 308/609] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:40.015661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.042795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.043871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.044377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.044848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.047467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:40.048000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.049699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.071048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:40.072290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 302/610] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:40.079343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.125075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:40.185966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b4f2-eaa6-4928-88f0-5eaff4b6fccf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.267963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b98602-b780-40df-b1e2-2a4ca379d94a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.272739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.273550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.273836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.274121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.301142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.302607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.313299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.314248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.314531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.314808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/1f86dd9b76ef42e8a6fbff301df7d3b8/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:40.335382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:40.336332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:40.337239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:40.337239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:40.337239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:40.337239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:40.338148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 309/611] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:40.344439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.354827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=1f86dd9b76ef42e8a6fbff301df7d3b8, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.356320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.381895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 303/612] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:40 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/1f86dd9b76ef42e8a6fbff301df7d3b8/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:40.484269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebd764-2e57-4fb9-a1d9-860d0c7867f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.512176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:40.541915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.542985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.543471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.543969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.544946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:40.545456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.547041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.563982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 310/613] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:40.569951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.625352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:40.686834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a85e1-44a9-45fd-848f-669576a28306 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.733544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.734388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.734615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.734893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.742288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.743721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:40.764147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:40.765121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:40.766032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:40.773105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.773644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 304/614] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:40.898514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f5038-189f-4b97-b346-f111a70865e1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.934501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.935233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.935515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.935791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.936704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:40.937015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.938435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6f306-eba5-48d7-81ec-71de67b42094 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.964239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 311/615] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:40.969632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.096760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3179-4cda-4a47-8971-3e12f0327a13 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.106706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf71c3-c1a0-4d5b-b392-e7aaf644020c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.107004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf71c3-c1a0-4d5b-b392-e7aaf644020c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.107285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf71c3-c1a0-4d5b-b392-e7aaf644020c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.108914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 312/616] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:41.114716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.114847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.115091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.115370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.141179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.141968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.142247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.142517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.143520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:41.144740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:41.154247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.155708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:41.175167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:41.176138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:41.177012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:41.177012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:41.177012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:41.177012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:41.177012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 305/617] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:41.198619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.228406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.301727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 313/618] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:41.335487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.366398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7690efa-6a48-4d1c-a1ef-f4dc6407f98b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.447607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.448816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.449094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.449362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.450085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:41.450385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.451748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.455732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23673066-cf31-4baf-a1d2-7667d52e1eae None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.481698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 306/619] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:41.497399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.518207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b444-c65b-43f4-acda-ef68db71a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.519027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b444-c65b-43f4-acda-ef68db71a752 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.519310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b444-c65b-43f4-acda-ef68db71a752 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.519587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b444-c65b-43f4-acda-ef68db71a752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.533626 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b444-c65b-43f4-acda-ef68db71a752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:41.534202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1ac9b444-c65b-43f4-acda-ef68db71a752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:41.541655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:41.542954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:41.544086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 314/620] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:41.544981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f9d7-5fae-43b4-b544-248eb16bcfbc None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.544981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f9d7-5fae-43b4-b544-248eb16bcfbc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.545221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f9d7-5fae-43b4-b544-248eb16bcfbc None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.546702 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 315/621] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:41.551250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f9d7-5fae-43b4-b544-248eb16bcfbc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.580803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.633962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a343fd-1a36-4421-9cf8-5ae7d62c0ed4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.663574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f9d7-5fae-43b4-b544-248eb16bcfbc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.678525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.680463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.681026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.681731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.690904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.693994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.702530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.703288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.703572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.703850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.704620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:41.704930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.706274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c35c-6d65-4f70-8da3-6cfbbe54a0ab None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:41.714119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:41.715293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:41.716409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:41.716855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 316/622] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:41.716855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.716855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.716855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.723726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 307/623] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:41.725844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.737951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:41.739391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:41.828040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 317/624] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:41.830079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.832199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.866961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.868765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3243-4d97-4c67-bc15-5b588d382259 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.917292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.918339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.918623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.918901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.933077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.935390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:41.958815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:41.959724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:41.961244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:41.961244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:41.961244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:41.961244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:41.964211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 308/625] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:41.965681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.979500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf5cd3-bc42-4f4a-b14a-95258d35d6cd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.028651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.029898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.030780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.031549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.032608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:42.033126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.035607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.056832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 318/626] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:42.058050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.076988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a8122-2933-4a8c-8085-41ad777337e3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.118000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.118888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.119224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.119615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.121685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.132168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:42.140959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:42.141870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:42.142674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:42.147096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 309/627] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:42.147991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.160541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.186288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0c02-d08d-494f-b320-756346f06cac None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.224168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.225800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.226249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.226705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.228253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:42.229474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.231622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.247795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 319/628] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:42.249330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.276768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c940b-c78c-4d36-ad75-a62185fc4993 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.311036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.311914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.312223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.312495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/eac24ebb573140718662633d85735b71/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.328843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=eac24ebb573140718662633d85735b71, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.330286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.347713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 310/629] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:42 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/eac24ebb573140718662633d85735b71/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:42.348589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.402485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1143-9c05-4e24-93a9-8aaa81ee92d1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.406815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.471796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca68486-19f2-4087-a4ca-1ca3244e94e5 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.474451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.475198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.475472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.475805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.476595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:42.476951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.478315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd48471-e593-4b96-9401-1c9bd52f860f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.484540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.498040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 320/630] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:42.499462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1652f-1084-4b10-a627-b52568432711 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.499775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1652f-1084-4b10-a627-b52568432711 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.500050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1652f-1084-4b10-a627-b52568432711 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.505930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 321/631] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:42.507328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1652f-1084-4b10-a627-b52568432711 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.518002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.519153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.519616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.520168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.531053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.533466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-35714c1b-4a1c-4be0-b387-59d086ab93a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:42.552851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:42.553866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:42.554786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:42.563124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 311/632] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:42.563124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.563124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.563124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.586020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:42.588104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:42.641324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1652f-1084-4b10-a627-b52568432711 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.664858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 312/633] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:42.665973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.678600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.679457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.679747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.680088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.692408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.694267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:42.713378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:42.714291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:42.715193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:42.715193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:42.715193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:42.715193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:42.715193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 322/634] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:42.724476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.728312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.786627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.809962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ea7c-e863-4741-b26e-c51312f1631d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.839402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d56e0-be32-467a-87ee-0ad783247f49 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.854795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.855781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.856446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.857200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.858250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:42.858756 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.861079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.877272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.877937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.878220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.878492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.879211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:42.880125 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.881494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fc379-f763-4ba1-b0d6-25d5a28d7d04 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.884219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 313/635] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:42.885126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.899377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 323/636] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:42.901064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb45d7-3296-4949-b59d-60d21597fd79 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.901425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb45d7-3296-4949-b59d-60d21597fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.901777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb45d7-3296-4949-b59d-60d21597fd79 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.903551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 324/637] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:42.907951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb45d7-3296-4949-b59d-60d21597fd79 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.986071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.996107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105d042-c484-4aa5-aad7-92801e9f3284 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.017340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb45d7-3296-4949-b59d-60d21597fd79 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.028905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.033385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.034172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.034452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.034723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.046267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:43.052959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.053597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.053875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:43.054058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.054948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:43.055784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:43.056532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.056603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 314/638] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:43.056603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.130657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.132121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.159148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24e95-9ba0-4f94-b3ac-def1fdef9b38 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.192787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.193578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.193862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.194140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.203101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.204564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a20be6ab-1190-42a4-9024-67012f973ed9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:43.218993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.219950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:43.221065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:43.224708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 315/639] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:43.225941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.226224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.226494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.246405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 325/640] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:43.246405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.247843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:43.249057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:43.256827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.257399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.317388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 316/641] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:43.318204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.366477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a074-5067-4ddc-94ae-1503cb843bbb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.403224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.403890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.404207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.404490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.405236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.405551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.406910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.420114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 326/642] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:43.420114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.430200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc22c6-6418-4a70-a27c-5ddb326c874e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.465931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.466599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.466880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.467155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.467978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.468312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.469716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.484243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.492281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 317/643] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:43.493131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.494139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.521819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81085-84bc-49bf-b303-0bc572578aa2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.555567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.556394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.556676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.557460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.567909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.569421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:43.588056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.589894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.592398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:43.592398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:43.592398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:43.592398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:43.596925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 327/644] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:43.597795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.612821 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db1971-acb4-4320-81a0-c3cafe765805 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.648883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.649793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.650206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.650489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.661492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:43.670441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.671433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 318/645] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:43.677672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.701547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58aca-b60a-4b24-b92d-8a369b64091f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.729849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.741663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.746846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.747644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.747930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.748313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.762021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.763891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.781600 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e6815-4b99-4f7f-b4d4-a3dee1dae010 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:43.785839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.787031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.787926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:43.787926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:43.787926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:43.787926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:43.787926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 328/646] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:43.788258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.821374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.822031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.822320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.822641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.890019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.891482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.906236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2332-c810-4d48-b6dc-3274ec20a8d3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.942937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.943731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.944015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.944319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.945043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.945346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.946708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.952803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.960402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 329/647] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:43.961403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.998676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 319/648] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:43.999500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.008045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.084856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20b3e7-ec58-4427-a1a6-4ca8ea5e3456 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.106998 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094e85-1211-418f-bf9b-4a9dab1e0351 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.120662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.121362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.121648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.121926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.122673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.122980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.124361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.133807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 330/649] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.134425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.149910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.151462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.151751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.152249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.152930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.153240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.154598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.171360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 320/650] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.171360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.196150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.239939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.244109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543f23b-a028-4b6a-aa36-fc0e617d8e07 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.280593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.281388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.281669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.281941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.289366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.289865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23a1eb-aeaf-4d97-8a68-cd596287b2cb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.290800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:44.305250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.306191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:44.307595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 331/651] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:44.308580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.332487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.333270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.333550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.333819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.344908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.346276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:44.363903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.364861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.365724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:44.365724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:44.365724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:44.365724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:44.365724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 321/652] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:44.367027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.417417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455fa3-331b-4a70-85ea-01ddc0bc1685 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.446919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.457190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.457991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.458270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.458543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.469290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.470726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.477459 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700172-fe76-41fa-8f33-0e08e8f99bbf None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:44.490646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.491551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.493277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:44.493277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:44.493277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:44.493277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:44.493277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 332/653] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:44.493277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.506572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.519993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.521043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.521489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.521761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.529658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.531076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:44.545415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.546488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:44.547452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:44.551069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 322/654] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:44.551905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.594121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ef7b-d48c-4b5e-a3c2-d50d78dbe2af None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.632126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.632700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.632982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.633259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.634050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.634359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.635846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.652217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 333/655] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.652764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6953-e55c-461e-bac0-3b650cb7c341 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.653017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.685236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.690875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.691535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.691821 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.692126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.692851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.693160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.694559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97a449-4191-4ab7-993e-1dab82f844e5 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.706428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 323/656] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.707658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf997-aa59-47bc-ac21-f6bf4f2b9fa2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.707951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf997-aa59-47bc-ac21-f6bf4f2b9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.708268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bf997-aa59-47bc-ac21-f6bf4f2b9fa2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.709746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 324/657] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:44.710302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bf997-aa59-47bc-ac21-f6bf4f2b9fa2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.725210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.756672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eda04-21da-4803-9542-4efd5144ce58 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.789451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.790106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.790386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.790663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.791923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.792265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.793620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.805168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 334/658] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.806033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.813150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bf997-aa59-47bc-ac21-f6bf4f2b9fa2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.846247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.846912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.847192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.847468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.848325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.848635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.850047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.866615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 325/659] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.867421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.909661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90945cfe-34e2-472f-8e4b-8c8cf54cb722 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.915628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.939607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.945905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.946565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.946851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.947129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.948273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=eb4489f887f944f0806b63b669ffb883) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.948586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.950015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfa95c-7e2e-4d10-81a9-e9d1d03d766c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.955842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 335/660] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/role_assignments?user.id=eb4489f887f944f0806b63b669ffb883&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:44.956951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.957235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.957513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.968124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f9c01-6255-49bd-b903-04d31df9a7ca None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.976806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:44.978083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:45.007568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.008425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.008711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.008986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.017078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.018611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:45.034410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:45.035357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:45.036270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 326/661] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:45.036745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.060977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 336/662] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:45.061859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.170111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ae0b3-852e-4c7f-ab10-16717404a207 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.182677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453f57b-5387-48bd-ad6a-16dcf18ca466 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.183434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.208019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.215657 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.216652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.217007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.217356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.219623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.220433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.220779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.221065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.226870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.228580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:45.247347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:45.248575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:45.249708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:45.251960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 327/663] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:45.252911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.296619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.298078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.361987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b29a1-0be0-494c-82d8-cd398312cc42 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.396943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.397601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.397888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.398165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.398949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:45.399259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.400782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.402271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 337/664] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:45.403107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.423138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 328/665] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:45.423138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.437465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.456122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.519250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4403534-f29e-442f-96e4-634a36f102e8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.529186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f9b49-82ec-448c-a7c2-beefd637b5c7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.559053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.560181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.560733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.561115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.564237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.564901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.565184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.565591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.566486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:45.566731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.568164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.573837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:45.583360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:45.584285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:45.590789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 338/666] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:45.591629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 329/667] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:45.591629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.591781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.676849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.685356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.693822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525414e7-a41d-4d95-b87b-25042c46250e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.700572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b346f4-b506-4e48-9f41-62233b41a620 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.729999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.730849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.731138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.731419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.736445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.737096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.737378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.737651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.738482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=11d05026ac51451a8c10fb63f840d15f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:45.738791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.740242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.742387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.744043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.746796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 330/668] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/role_assignments?user.id=11d05026ac51451a8c10fb63f840d15f&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:45.747583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:45.773957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:45.774928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:45.775838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:45.775838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:45.775838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:45.775838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:45.782329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 339/669] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:45.783522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.873377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380564c-c50a-4e0b-97ee-7bec10344f37 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.921272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.921982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10529150-5102-4ec8-807f-040d2a022b37 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.922700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.923133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.923639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.924601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:45.925149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.926674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.939226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 331/670] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:45.941741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.963567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.968845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.969505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.969789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.970066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.976313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.058288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.059752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.078057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b207957-5f1e-4069-a09d-461fdbda7275 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.119224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.120746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.121036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.121314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.122065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:46.122377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.123796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.137749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 332/671] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:46.138619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.193186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 340/672] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:46.194383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.226270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.261147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4c853-9f95-429e-9e4f-0db54af5670c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.272506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.304169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.305118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.305408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.305690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.307189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413304ce-4377-4e34-8b39-7f52fa179e5f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.316886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.318452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:46.336601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:46.337576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:46.338974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:46.338974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:46.338974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:46.338974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:46.343150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 333/673] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:46.343866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.348607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.349410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.349694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.349971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.365710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.367989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:46.387483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:46.388450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:46.389336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:46.392578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 341/674] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:46.393472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.468707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fb1b7-955a-405c-aef2-ca39eafc1eae None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.502195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.505170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448642f6-8e78-4d6e-83ed-100f3092070d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.508401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.514203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.515451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.515747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.516038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.529941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.531712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.543778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.544775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.545284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.545782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.546734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:46.547257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.548959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:46.552888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:46.553788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:46.554714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:46.554714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:46.554714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:46.554714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:46.554714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 334/675] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:46.555401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.576088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 342/676] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:46.576088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.674326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661ac10-a359-40a4-919d-113a897364f2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.710168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.710693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.710972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.711243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.712033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:46.712372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.713871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.718606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c65005-c0ff-44d5-8e83-67d3632e1be0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.731906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 335/677] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:46.732756 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.764371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.766050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.766582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.767065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.768283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:46.769719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.771311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.775020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.793866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 343/678] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:46.793866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.824050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.851077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662f06-ed0b-428a-b11d-62ff6010bde7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.898818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.899605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.899885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.900477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.908074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.909680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:46.925611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:46.926561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:46.927492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:46.928745 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddf2f4-590c-4cd0-a5b3-1740ddc5a36b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.931445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 336/679] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:46.932627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.977147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.977818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.978099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.978378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.979330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=b7de00325c784e79be24c9928dd535e5) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:46.979643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.981117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.987754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 344/680] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/role_assignments?user.id=b7de00325c784e79be24c9928dd535e5&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:46.988529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.079912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.090766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.095633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97af2-0ce3-4495-9ef5-73de68fad9b4 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.102922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e362ca-7ef6-4ed7-b3eb-75043a6ef46f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.132747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.133561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.133847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.134122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.141339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.142172 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.142563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.142952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.143863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.144106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.144409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.145958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.146116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cc7b403b-d70f-4bda-b7fb-d83f6b63748b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:47.162519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:47.163692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:47.164858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:47.167214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 337/681] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:47.168790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b58b-312e-4744-8099-2fbd16d41b1a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.169196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 345/682] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:47.169531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b58b-312e-4744-8099-2fbd16d41b1a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.169820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b58b-312e-4744-8099-2fbd16d41b1a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.171316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 338/683] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:47.172459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.176028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b58b-312e-4744-8099-2fbd16d41b1a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.290127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3aaba-5400-4d45-8667-04865e2a9cbd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.293814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b58b-312e-4744-8099-2fbd16d41b1a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.330848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.331711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.332002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.332403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.333495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.333814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.334532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.335175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.335375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee66fb-7b3a-4e39-ac88-dff39804105e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.335479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.335740 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.348148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.355142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 346/684] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:47.356549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.356834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.357111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.366671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.377059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:47.378254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:47.416038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.418161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.457502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 347/685] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:47.459295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.529079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 339/686] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:47.529936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.587831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16a6e-d77b-417c-8f97-00bafe4c90e5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.595771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.626637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.631170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.631857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.632597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.632877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.633991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=1f86dd9b76ef42e8a6fbff301df7d3b8) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.634310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.636456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.652122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3712-2566-4430-9b50-4d9803bcf4ee None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.652882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 348/687] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/role_assignments?user.id=1f86dd9b76ef42e8a6fbff301df7d3b8&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:47.654035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.688951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.690235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.690518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.690794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.704216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.705972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:47.732145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:47.733083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:47.733953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:47.733953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:47.733953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:47.733953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:47.733953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 340/688] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:47.735706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.853447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729cb49-80ad-43f4-b6dc-2377c1d999b7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.856029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd51b40-645c-4ca8-a860-d6aa9005de45 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.880593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.893073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.893880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.894166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.894448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.909422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.909605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.910158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.910377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.910654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.910875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.911386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.911694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.913088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.925961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 341/689] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:47.931526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:47.934939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:47.936304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:47.937171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:47.937171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:47.937171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:47.937171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:47.937171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 349/690] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:47.945036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.000368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.057165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df06f7-0833-4c47-b801-63cbb5a10d17 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.067152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6d87-fe08-409a-b94c-15d160c1a47b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.103661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b02555-3f5f-4c4d-a368-67b0b945c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.104888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b02555-3f5f-4c4d-a368-67b0b945c69f None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.105176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b02555-3f5f-4c4d-a368-67b0b945c69f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.105454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b02555-3f5f-4c4d-a368-67b0b945c69f None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.106165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b02555-3f5f-4c4d-a368-67b0b945c69f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.107607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b02555-3f5f-4c4d-a368-67b0b945c69f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.113836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.114855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.115376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.115922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.116978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:48.117487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.119091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.130028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 342/691] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:47 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:48.133272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 350/692] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:48.136751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b2fe-23cd-4e78-9f1b-f1402c4e67f7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.137347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b2fe-23cd-4e78-9f1b-f1402c4e67f7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.138009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b2fe-23cd-4e78-9f1b-f1402c4e67f7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.139184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.141785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 343/693] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:48.147739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.148346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.153671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.188967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:48.192963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:48.243054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.329480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 344/694] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:48.337209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a922e3b-5541-43db-b71c-c16cda12f997 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.339647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.353438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.381646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.382492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.382781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.383164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.392373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.395070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:48.414294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:48.415214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:48.416104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:48.416577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 351/695] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:48.422328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.465530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1839e7-30e6-45b7-b2af-0066db4c94aa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.511258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.512142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.512440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.512708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.535959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:48.547080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:48.548021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:48.548869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:48.549492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 345/696] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:48.555463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.578982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e239dc-7219-4a6f-92ae-d13781831c62 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.582844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.623895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.624593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.625866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.625866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.626044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:48.626228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.627656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.641682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 352/697] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:48.647471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.698181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c6548-7c72-4798-b940-35044e227c87 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.700558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.764646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.765394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.765675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.765947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.766703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:48.767001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.768380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.790395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 346/698] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:48.795748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.811092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f739646-a701-4cbf-ad60-1808847ee824 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.874911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.876133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.876433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.876788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.877688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=eac24ebb573140718662633d85735b71) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:48.878007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.879462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.901573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 353/699] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/role_assignments?user.id=eac24ebb573140718662633d85735b71&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:48.964466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.984966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e95d2-a56c-4d58-9619-4d82f97cf17b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:49.020959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:49.021770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.022048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.022319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.034614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:49.036092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:49.055400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:49.056450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:49.057700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:49.057700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:49.057700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:49.057700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:49.057700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 347/700] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:49.063628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:49.188367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:49.205462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa607b-a13b-4a55-ad00-ccd1c8b282ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:49.239462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:49.240156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.240444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.240722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.241441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:49.241815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:49.243238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:49.256613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 354/701] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:49.262241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:49.378219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76ede-d09b-44b0-9d22-2e1499e936fa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:49.407133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:49.414505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:49.415297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.415581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.415858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.424411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:49.425846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-204e6b8a-9931-4de0-a3a3-dad461dfeef7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:49.440498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:49.441427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:49.442781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 348/702] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:49.447067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:49.460817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe161-175d-4713-8a5f-5c0f017bd3d4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.461404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe161-175d-4713-8a5f-5c0f017bd3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.461905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe161-175d-4713-8a5f-5c0f017bd3d4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.464383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 349/703] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:49.473252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.473799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.474474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.491476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:49.492967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:49.567320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 350/704] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:49.577129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7fc1-2672-407b-b91b-b90ad84ed1b0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:49.591635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:49.625286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:49.627345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.628552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.629216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.630874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:49.632154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:49.634359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:49.660389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 355/705] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:49.666736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:49.685529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:49.811114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ed5bd-2f62-4a0a-8e79-6d8608325339 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:49.812209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2eac-2090-48b6-b605-565450d76ddb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:49.857977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:49.859022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.859511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.864393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:49.867990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.897808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:49.898862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.898976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.899264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.900053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:49.901521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:49.934514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:49.935531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:49.940819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 351/706] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 14 10:40:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:49.956940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:49.962777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:49.965307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:49.974186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.082028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7272a-8d5f-4279-9b0e-6201381e956a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.124905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.126808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.131060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.131364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.132144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:50.132465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.133853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c5429-8f9d-42fd-858d-cfe7650085d0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.139072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 352/707] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:50.144087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c600abf-6f79-401d-9a35-0365326ec93c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.144087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c600abf-6f79-401d-9a35-0365326ec93c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.144087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c600abf-6f79-401d-9a35-0365326ec93c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.146151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 353/708] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:50.147443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.147834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.148258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.166046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:50.167938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:50.173342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 356/709] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:50.174739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.221248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.256353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 354/710] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:50.257371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.317789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354dc6c-b99a-48a6-b815-56fbd2ce0f61 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.328922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.368862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.370447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.370942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.371401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.372900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:50.373661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.375208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.375510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594ae9-5a6f-49d5-9c8a-6687dbe33d5b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.388627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 357/711] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:50.388627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.438578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.439729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.440229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.440736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.463114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.465053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:50.504168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:50.505296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:50.506295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:50.506295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:50.506295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:50.506295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:50.514036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 355/712] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:50.520918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.586180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.596789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b836-decc-4cac-9683-97037d7bbef5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.637577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.638615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.639050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.639488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] PATH_INFO: `/v3/services/network` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.640333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.641856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:50.658244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:50.659520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:50.661497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:50.665065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 358/713] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:50.669730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41636b2b-863a-4564-8b48-4f9bdab71c16 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.672018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.711205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.711982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.712344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.712713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.714113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:50.714506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.715856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.716806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af246573-962c-4d09-95aa-7f42464c219a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.732192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 356/714] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:50.733617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a1c6-b077-4b73-9923-e660671484ca None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.734075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a1c6-b077-4b73-9923-e660671484ca None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.734417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a1c6-b077-4b73-9923-e660671484ca None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.736095 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 357/715] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:50.740721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0a1c6-b077-4b73-9923-e660671484ca None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.803087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7e13-dda5-4cc3-9dc2-2221ed25db3e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.846007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.848483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.849899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.850256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.850607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.851627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:50.852071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.853527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492ca2f-fd02-4739-8b21-ea5d409740a3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.858860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 359/716] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:50.864581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0a1c6-b077-4b73-9923-e660671484ca None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.865964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.866548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.866980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.893103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:50.894722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:50.907411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.909799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.910087 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.910629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.921932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.924764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:50.942928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:50.943817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 358/717] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:50.945300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.987773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 360/718] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:50.987773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.036728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.079344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6065f0b-3bae-4a75-95a0-c08f5165966b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.124701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b4653-2e1a-49b0-90ae-f29265bef15d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.125397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.127728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.128350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.128886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.129814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] RBAC: Adding query filter params (type=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:51.130333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.131912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.148365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 359/719] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:51.148365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.184280 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.195017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.195714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.196000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.196304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.197109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:51.198222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.202923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.237063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 361/720] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:51.240719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.359977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099c9e-9a86-42ee-9655-8a1a36ec0a70 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.400145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.414393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.415471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.415964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.416207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9143-d94f-413d-b88b-7c1d77461667 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.416680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.431286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:51.442111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:51.443049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:51.443871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:51.451180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 360/721] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:51.452690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.480525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.483448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.483943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.484471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.485991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=11d05026ac51451a8c10fb63f840d15f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:51.487137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.488963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44e56b-b381-420c-825f-d1b3aa8e8fd8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.501091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 362/722] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/role_assignments?user.id=11d05026ac51451a8c10fb63f840d15f&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:51.558684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.596586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49ae5-8a1e-4180-8af8-b264931c78cd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.611836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dbc43-74be-479c-b5a5-7de407186ddd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.612176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dbc43-74be-479c-b5a5-7de407186ddd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.612499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dbc43-74be-479c-b5a5-7de407186ddd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.614250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 363/723] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:51.620261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.620853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.621331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.647331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.648024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.648339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.648618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.649383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:51.649693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.652180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.658977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:51.660537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:51.667146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 361/724] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:51.669504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.762286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 364/725] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:51.798386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.853137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7368-b42e-4c8e-86ad-0642776115f3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.912997 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.913944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.914253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.914497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.918156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.928587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.930576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.944393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:51.951463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:51.952399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:51.953328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:51.953328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:51.953328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:51.953328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:51.955652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 362/726] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:51.961433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.990295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960aad8-e898-4f0f-9e25-62ceefff109c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.072570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607e446-093e-48ef-b6ba-5d2a89fa271c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.085360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.086175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.086458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.086736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.109898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:52.123714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:52.124719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:52.125547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:52.128763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 365/727] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:52.138854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.144360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.145587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.147102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.147618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.151441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.153754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.155370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.179530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 363/728] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:52.185202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.288213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955591f-79ec-4f1c-8f38-860b3c000401 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.302595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.331437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.332132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.332422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.332701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.333461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.333775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.335144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.356376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 366/729] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:52.361532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.369789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.384392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5c0ef-7937-4780-ad24-ba7ed601d859 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.428388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.431586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.432160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.433094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.450121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.453923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:52.480013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:52.481018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:52.481946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:52.484948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 364/730] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:52.492938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.539596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750bd6-c785-4008-96b2-eaf7c165dc7e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.577615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.578088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.578375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.578651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.590398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.592026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:52.611086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:52.612006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:52.612949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:52.612949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:52.612949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:52.612949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:52.612949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 367/731] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:52.615856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ead665-2a3f-44ea-b5ae-d818f2978484 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.618242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.626040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.667640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.668434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.668735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.669226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.670064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.670178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.671616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.683556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.706762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 365/732] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:52.713092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.737327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bb511-7fff-4a1a-9762-ed0059f01169 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.773646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.774625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.775055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.775585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.776472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.776921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.778547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f56a1-d34c-4590-8629-9e86ec4c77cc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.792921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 368/733] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:52.798744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4a69-c11c-477a-bb8a-764af623fbf2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.799198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4a69-c11c-477a-bb8a-764af623fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.799623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4a69-c11c-477a-bb8a-764af623fbf2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.801292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 369/734] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:52.802204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4a69-c11c-477a-bb8a-764af623fbf2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.865831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07218-5e1b-44e9-8928-7c44f32deb5a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.914382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.915667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.916599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.916996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.926628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4a69-c11c-477a-bb8a-764af623fbf2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.945726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.962501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.969648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.970673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.971127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.971654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.980115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.981869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-476cee1c-89cf-43a6-9c1d-11fee660bc1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:52.999046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:53.000204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:53.001178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:53.002289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.003789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.003972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 370/735] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:53.005492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.005959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.006445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.023955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:53.025656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:53.101030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 371/736] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:53.102223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.138288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 366/737] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:53.144321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.215542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3903c-8540-475a-80be-9de88a45c6ba None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.225175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.226480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.257773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.258886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.259435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.260544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.261722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:53.262259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.263921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.269239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639dbc1-6a45-4eab-b5f6-752ac52fd720 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.285388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 372/738] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:53.286625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.315212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.316307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.316818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.317330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.318336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.319922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.338401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 367/739] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:53 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:53.339856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.455143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab1529-75cb-411a-9fcb-85ed1161ee5d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.475749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7713c7-4cda-4525-a38b-4036c3e3684d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.504369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.521602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42561e-9597-480c-a0f1-34b3d2d00f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.522669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42561e-9597-480c-a0f1-34b3d2d00f16 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.523181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42561e-9597-480c-a0f1-34b3d2d00f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.523674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42561e-9597-480c-a0f1-34b3d2d00f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.555336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.556156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.556437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.556815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.569215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.570673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:53.591941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:53.593024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:53.593905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:53.593905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:53.593905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:53.593905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:53.593905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 373/740] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:53.598558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.606873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42561e-9597-480c-a0f1-34b3d2d00f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.609135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42561e-9597-480c-a0f1-34b3d2d00f16 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.619317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.710510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233cc8-6b21-452a-8b84-2a37b5a127f7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.746449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 368/741] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:53.747724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7aad1-8fd5-472e-97e1-f1a0b2ff1913 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.748014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7aad1-8fd5-472e-97e1-f1a0b2ff1913 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.748330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7aad1-8fd5-472e-97e1-f1a0b2ff1913 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.749826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 369/742] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:53.751343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.752296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.752781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.753256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.760452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:53.760452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.760694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.760774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.760850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.760850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.774711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 374/743] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:53.775657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.776988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:53.778174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:53.796841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.867412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.903215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7766ee3-896a-4a41-9d61-f209f3f244f6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.940284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.941100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.941377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.941653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.954305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.955869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.971508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 370/744] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:53.972673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5fa317f3-e135-4fb4-af3b-68fa1dd70183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:53.980471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:53.981365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:53.982247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:53.982247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:53.982247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:53.982247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:53.984207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 375/745] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:53.985726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd199-c497-4639-860d-ef5c61a79e6b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.986207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd199-c497-4639-860d-ef5c61a79e6b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.988795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd199-c497-4639-860d-ef5c61a79e6b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.990722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 376/746] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:53.991841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfd199-c497-4639-860d-ef5c61a79e6b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.086150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a04db2-6d8c-424d-b4bf-6485807186a8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.100133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfd199-c497-4639-860d-ef5c61a79e6b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.122278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.123182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.123783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.123893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.126624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.132344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.133810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.135740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.136434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.136712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.136994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.137706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.138016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.139355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f5d36fd0-0df3-483c-8590-65b7f109649d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:54.149242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:54.150148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:54.151146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 371/747] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:54.151967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.152094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.152320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.157402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 377/748] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.158380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.174486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:54.175689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:54.183242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.247316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 372/749] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:54.248968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.285188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e01f-3b98-4637-bbf9-d52e08d9e164 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.324723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.325546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.325838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.326116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.327340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.328729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.345500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 378/750] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:54 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:54.346592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.374531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaa733-3fa2-486d-bd27-86d9980a80fb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.412471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.429831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.431235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.432006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.432966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.434332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.434872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.436928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.447103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.464007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 373/751] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.464007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.492224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbf6a4-d729-4bb1-b755-9ce4ca25a60f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.538131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.539039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.539329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.539718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.547978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.549575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:54.564483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:54.565457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:54.566773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 379/752] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:54.567247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.585047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bdc64-2564-4453-96af-5e4598f683c2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.622486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.623197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.623477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.623740 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.634658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:54.642590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:54.643541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:54.644761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 374/753] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:54.648902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.689887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d64e3-bc02-4a08-931d-e5f7eea9e2d5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.703488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.722585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.730774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.731548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.731901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.732267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.733193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=55723830ec2c4ccab79e51f19c58b3bf) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.733573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.735087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.741953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 380/754] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/role_assignments?user.id=55723830ec2c4ccab79e51f19c58b3bf&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.742848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.788223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b1802-fcfc-488b-8fdf-85f0638be834 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.843140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.844167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.844645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.845101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.846235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.846759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.848435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.860214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d197505-3bda-4bb0-a0d5-bf92b13b650b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.880198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 375/755] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.882362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.898573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.899367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.899657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.900013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.909221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.909637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.911691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.922379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 381/756] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.940041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.985709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.046045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74999fd-88eb-4258-8cf2-ead2ff827d77 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.065949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb08a3-1607-45ba-bd3c-af1e5aaa2cfe None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.084419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.085213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.085493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.085768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.099008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.100671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.108417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:55.122791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.123896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.125024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:55.125024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:55.125024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.125024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:55.125024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 382/757] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:55.132514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.154968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.155761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.156141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.156484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.157388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=eac24ebb573140718662633d85735b71) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.157767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.159258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.165689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 376/758] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/role_assignments?user.id=eac24ebb573140718662633d85735b71&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:55.264636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.286604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb8d65-233a-448a-b08e-931cb17e8bdd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.331592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.332389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.332753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.333097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.333900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.334273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.335693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.354636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 383/759] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:55.360078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.465945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b1c7a-4644-4b08-b134-ef58309a0b05 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.502577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.503439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.503723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.503995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.512545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.514055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:55.528879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.531013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:55.533321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 377/760] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:55.541499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.642383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b2760-f88f-4853-9877-2cc2258fff8c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.682694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.683616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.684040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.684510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.685584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.686051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.687656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961be4-3a3e-4587-9594-308af0beb019 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.710094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 384/761] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:55.716046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.773582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.843585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442eee-2203-4c8b-aec1-e12c8c6a3a9b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.892755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.893547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.893890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.894165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.904424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb79d18-ec7c-406a-b192-d8a5e5c21820 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.904709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb79d18-ec7c-406a-b192-d8a5e5c21820 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.904982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb79d18-ec7c-406a-b192-d8a5e5c21820 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.906333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 385/762] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:55.910096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.911549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.912539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.912823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.913096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.919217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.931844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:55.933345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:55.937650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.938506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.939372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:55.939372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:55.939372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.939372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:55.939372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 378/763] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:55.944290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.018494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 386/764] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:56.070159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.076416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.083955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde62b2-8a8b-4414-8a2c-2dfb39e10777 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.126085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.126705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.126982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.127254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.127974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:56.128303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.134448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.163318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 379/765] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:56.173593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.252830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1f3c-c7ac-4e36-9bbe-9f72acc1fdc3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.293318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.293318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.293318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.293318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.293690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.293690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:56.307994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:56.308945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:56.309763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:56.310610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 387/766] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:56.311765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.317203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.351795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02ecb-dd66-4119-accd-132533287872 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.415238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.416574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.416858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.417128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.441162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.442625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:56.471301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:56.472220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:56.473089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:56.483956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 380/767] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:56.489707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604e05-e9e8-49d9-9950-791ca21d8ae2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.498433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.519551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.563310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.563866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.564178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.564462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.565187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:56.565503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.566872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.580808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 388/768] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:56.585636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.666635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb318f52-f04f-4327-9699-9f27fb192295 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.677215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.713451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.714561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.715050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.715518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.716573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:56.717080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.718768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.732284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 381/769] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:56.741943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350de22c-a63f-4f75-845b-75982993c7ab None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.745230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.787539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.788234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.788516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.788791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.789499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:56.789805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.792364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2506-f18f-4081-8348-93fa55d34ee7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.799946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 389/770] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:56.801778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57428c-eba3-46eb-bcba-121f9a7cc9ea None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.802068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57428c-eba3-46eb-bcba-121f9a7cc9ea None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.802347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57428c-eba3-46eb-bcba-121f9a7cc9ea None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.808260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 390/771] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:56.808260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57428c-eba3-46eb-bcba-121f9a7cc9ea None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.835623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.875552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e257aa-4d8e-4d2f-9a5e-b3dd4816e978 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.911982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0262dd9-2c97-4598-8fa6-ad1c199f40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.913257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0262dd9-2c97-4598-8fa6-ad1c199f40d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.913748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0262dd9-2c97-4598-8fa6-ad1c199f40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.914229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0262dd9-2c97-4598-8fa6-ad1c199f40d3 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/11d05026ac51451a8c10fb63f840d15f/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.916759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0262dd9-2c97-4598-8fa6-ad1c199f40d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=11d05026ac51451a8c10fb63f840d15f, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.918495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0262dd9-2c97-4598-8fa6-ad1c199f40d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.935307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 382/772] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:56 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/11d05026ac51451a8c10fb63f840d15f/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:56.936909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.937407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.937915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.941351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57428c-eba3-46eb-bcba-121f9a7cc9ea None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.958508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:56.960114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:56.991061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.014093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.014858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.015185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.015511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.016747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] RBAC: Adding query filter params (interface=public, service_id=333e8ce79ff2468fb6d7d34965130a0e, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:57.016863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.018363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.036778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 391/773] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/endpoints?service_id=333e8ce79ff2468fb6d7d34965130a0e&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:57.042082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.048798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 383/774] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:57.077076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.160791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.201806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8772-7865-4bca-98a3-8028facfa4f6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.238075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.239965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.240670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.242009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] PATH_INFO: `/v3/services/network` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.242875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.249099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:57.264349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:57.265406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:57.266244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:57.277230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 384/775] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:57.284025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.301928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631105a7-d03e-488f-94af-5ce75d0c48c5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.346842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb82de9-fad2-439d-9987-78a0578e0a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.347533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb82de9-fad2-439d-9987-78a0578e0a06 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.347815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb82de9-fad2-439d-9987-78a0578e0a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.348134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb82de9-fad2-439d-9987-78a0578e0a06 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.349067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb82de9-fad2-439d-9987-78a0578e0a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.351151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb82de9-fad2-439d-9987-78a0578e0a06 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.359008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 392/776] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/services => generated 772 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:57.360635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d30c47-9002-411d-9124-f4e4ad9fcc6f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.360923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d30c47-9002-411d-9124-f4e4ad9fcc6f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.361199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d30c47-9002-411d-9124-f4e4ad9fcc6f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.363498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 393/777] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:57.370234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.370549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.370731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.390818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:57.392130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:57.446041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dbd03-65f4-4cdc-a922-c6247c107299 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.455685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.480653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 394/778] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:57.505813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.521123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.546136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.546974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.547256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.547527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.548265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] RBAC: Adding query filter params (name=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:57.548572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.549938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.566426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 385/779] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:57.574272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.653736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732349b8-6d9b-45ee-8152-d6514338a1e6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.722323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.723460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.723988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.724455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c03cc1-1041-4d44-a843-9b28fa872186 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.724725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.752138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:57.759293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.760752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.761224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.761727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.762964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] RBAC: Adding query filter params (type=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:57.763472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.765260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:57.768104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:57.769005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:57.769830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:57.771732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 395/780] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:57.775709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 386/781] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:57.776653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.780978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.839605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.876437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.890835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722837f8-0270-43ac-9c4d-f7ab9432cb67 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.912873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237172ce-7c22-403f-a4c1-5371f25465ad None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.926737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.928986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.929295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.929569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.930750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] RBAC: Adding query filter params (interface=public, service_id=01fa73faa552403195a58d781552ad06, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:57.931279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.933019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54370804-80ef-4da3-be9a-66605f81bdae None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.942530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 387/782] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/endpoints?service_id=01fa73faa552403195a58d781552ad06&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:57.950104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017309a-2d0b-4ab8-a05f-1076f09ee351 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.950104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017309a-2d0b-4ab8-a05f-1076f09ee351 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.950104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017309a-2d0b-4ab8-a05f-1076f09ee351 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.950104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 388/783] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:57.950104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017309a-2d0b-4ab8-a05f-1076f09ee351 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.958225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.959215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.959755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.960290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.961295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:57.961843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.963561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df780977-c2c0-4981-8d5f-70733fb1e3bf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.975238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 396/784] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:57.977464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.977964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.979111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.004628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:58.005806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:58.075250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017309a-2d0b-4ab8-a05f-1076f09ee351 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.092174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 397/785] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:58.093083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.098063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.115335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.116390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.116884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.117740 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.118643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.120466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.126750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 389/786] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:58.143625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.147982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.268734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b1a2-2e0e-4be7-a972-b4e4c0a3905d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.288868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2396c-8894-4a78-80d7-1e47c69351fc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.344542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.345341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.345622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.345896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.350358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.351454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.351953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.352700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.358543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:58.365330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.366950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:58.367244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:58.368390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:58.369881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:58.375425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 390/787] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:58.376697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:58.392991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:58.393912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:58.394792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:58.394792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:58.394792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:58.394792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:58.397463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 398/788] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:58.403416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.433844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.500530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e3786-7cc0-4fb3-b3a1-da239fe19621 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.538089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.555466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327e25-aa4c-4720-8870-4a3da3faede5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.567460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.568174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.568455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.568723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.569484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:58.569789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.571206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.591914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 391/789] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:58.594006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.629764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.632562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.632844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.633115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.634728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:58.635040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.636427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.657295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 399/790] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:58.663587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.770001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9cc7f-cbfc-4abf-beec-1b619285a084 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.806150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf9dd-2c0d-4e1d-877e-ff8de9c0c9de None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.806329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b430b-d094-429b-8803-588520beacce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.807511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b430b-d094-429b-8803-588520beacce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.808020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b430b-d094-429b-8803-588520beacce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.808527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b430b-d094-429b-8803-588520beacce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.813778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.817309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b430b-d094-429b-8803-588520beacce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.818998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b430b-d094-429b-8803-588520beacce None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1c0b430b-d094-429b-8803-588520beacce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:58.835483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:58.836483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:58.837406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:58.840109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 400/791] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:58.849219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b430b-d094-429b-8803-588520beacce None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.851872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.852862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.853059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.853298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.864099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.868091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.868211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:58.884333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:58.885324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:58.886195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:58.886195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:58.886195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:58.886195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:58.886195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 392/792] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:58.891174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.053830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b430b-d094-429b-8803-588520beacce None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.087451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254c8b-5fc5-4d19-8b63-cabe3caf457a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.124213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.124891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.125169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.125439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.126281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.126586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.128032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.156789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.157472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.157777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.158057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.158790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.159093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.160482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.165154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 401/793] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:59.170762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.188995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 393/794] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:59.192906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.215720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.302949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf0e70-7a33-4b94-9476-3429f7bc6111 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.327618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.342442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.343169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.343450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.343716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.352008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.354538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.374109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07f7c7-a730-4614-93c1-bd3bd7ae4583 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f41449bd-67b6-4da4-ad2b-f2fc091b6848 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:59.386709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.387669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:59.388970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 394/795] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:59.396131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761a0c-5ec3-4cfa-ae77-451c40699d64 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.396131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761a0c-5ec3-4cfa-ae77-451c40699d64 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.396131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761a0c-5ec3-4cfa-ae77-451c40699d64 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.396131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 395/796] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:59.396131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761a0c-5ec3-4cfa-ae77-451c40699d64 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.449492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.450299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.450583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.450859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.461813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.463830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9eaba52f-9fcf-4d0c-a243-c69621dda053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:59.481890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.482833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.483963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:59.483963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:59.483963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:59.483963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:59.487861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 402/797] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:59.489200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.489408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.489672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.497962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.507780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:59.509300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:59.522843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761a0c-5ec3-4cfa-ae77-451c40699d64 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.559444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.560563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.561054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.561532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.562648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.563177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.564926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.583662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 403/798] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:59.584639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.590849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 396/799] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:59.592388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.651801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.692634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa05756-3da6-4a1c-a04e-abe102e8e98d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.697042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2672db-ce69-4337-afc3-9e571974599e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.733566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.734066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.734262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.734514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.734792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.734900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.735113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.735383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.735552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.735820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.737240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.738776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.749316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.754567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 404/800] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:59.754707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.754799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d2182c2b-5103-4eee-9386-58a8575bf217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:59.773576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.774499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 397/801] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332633a-d083-411f-8859-3e3e4b503663 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332633a-d083-411f-8859-3e3e4b503663 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.780107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332633a-d083-411f-8859-3e3e4b503663 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.782346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 398/802] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:40:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:59.783117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332633a-d083-411f-8859-3e3e4b503663 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.863959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da719-0033-4157-a044-0a9d1270df76 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.874111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.898770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332633a-d083-411f-8859-3e3e4b503663 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.900600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.901467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.901882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.902165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.912767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:59.920606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.921536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:40:59.922354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 405/803] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:59.923045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.940745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.941682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.941960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.942230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.949834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.951247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2e377267-5c14-45f3-80b2-03fd5c4d8ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:59.964918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.965851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:40:59.966732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 399/804] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:59.968119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.968119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.968119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.984774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:59.985932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:00.031232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.036282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a583d-5e09-42c2-bffa-7b64ce47a2ce None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.065253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 400/805] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:00.065253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.082542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.083503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.083799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.085180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.086138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.086462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.088499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.110171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 406/806] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:00.110171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.148050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.219805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c3eba-d1ff-43a3-889f-3e751ca6b0fe None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.238688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58893a-19dd-4821-9e22-20cd1a07864e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.262122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.263065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.263352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.263634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.265077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.265491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.267125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.281919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 401/807] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:00.282090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.282187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.282258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.282258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.282258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.282258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.282258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.282258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.297234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 407/808] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:00.298189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.326753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.394726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff092fc-c39f-4795-b45f-796fe3a8aa79 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.421584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.439762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.440884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.441386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.441858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edea0b8-03eb-4c44-a11d-7ca197249c08 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.441971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.442794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.444397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:00.460352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:00.461509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:41:00.462633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:00.466252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 402/809] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:00.467216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.490843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.491622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.491909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.492235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.499792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.501285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:00.515949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:00.516936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:00.517809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 408/810] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:00.518295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.574268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90b26c-9206-43cb-9805-1f251c9c3268 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.576834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.609552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.610342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.610626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.610947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.621498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.622935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.627509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0e56-68e5-4d93-b0ca-ae18e6ce8065 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:00.640559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:00.641437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:00.642289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:00.642289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:00.642289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:00.642289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:00.642289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 403/811] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:00.642668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.666698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fba9ce-44b6-4f3c-85f5-940c41c9e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.667590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fba9ce-44b6-4f3c-85f5-940c41c9e9ff None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.667884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fba9ce-44b6-4f3c-85f5-940c41c9e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.668200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fba9ce-44b6-4f3c-85f5-940c41c9e9ff None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/55723830ec2c4ccab79e51f19c58b3bf/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.682980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fba9ce-44b6-4f3c-85f5-940c41c9e9ff None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=55723830ec2c4ccab79e51f19c58b3bf, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.684455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fba9ce-44b6-4f3c-85f5-940c41c9e9ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.693356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.699478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 409/812] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:00 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/55723830ec2c4ccab79e51f19c58b3bf/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:00.700971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5b89-9bc7-43e8-a01c-a67895022217 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.701375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5b89-9bc7-43e8-a01c-a67895022217 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.702037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5b89-9bc7-43e8-a01c-a67895022217 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.707480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 410/813] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:00.707480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5b89-9bc7-43e8-a01c-a67895022217 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.751473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e03091-6d0f-4955-9041-e98cc1127ba0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.798094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.798777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.799471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.799750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.800786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.801097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.803245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.809633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 404/814] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:00.810490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.829825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5b89-9bc7-43e8-a01c-a67895022217 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.837666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.874116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.874768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.874903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.875067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.875853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.876195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.877626 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842c78-2917-4475-9c42-8821dbd518cb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.895770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 411/815] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:00.895770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.895770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.895770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.915267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:00.917422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:00.928734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ece79f-ca14-44a4-836b-af95ab386f7c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.964702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.965366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.965648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.965925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.966649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.966961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.968355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.975985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.985430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 405/816] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:00.986176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.991695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 412/817] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:00.992381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.081790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.095661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c45c-84d3-4564-ba48-86f742359caa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.102097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98fee1-2dcb-4adf-a589-33666ba0ae97 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.132203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.133086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.133366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.133640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/eac24ebb573140718662633d85735b71/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.135609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=eac24ebb573140718662633d85735b71, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.137117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.137732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.138396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.138679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.138956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.139664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:01.139969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.141476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.146753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 406/818] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:01.147543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.155202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 413/819] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:00 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/eac24ebb573140718662633d85735b71/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:01.155845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.226388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.288370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645ebb1-b3bb-4a18-b369-e2dd23b985a3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.310085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34d4b1-ba14-4769-9005-5d5e8aee48cc None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.328912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.330471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.330985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.331494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] PATH_INFO: `/v3/services/network` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.332969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.334294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:01.346949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:01.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:01.349324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 414/820] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:01 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:01.350134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.357014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.358138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.358430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.358805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.369987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.372100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:01.389930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:01.390900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:01.391827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 407/821] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:41:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:01.392431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.396650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.477753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2c240-e1c6-4b83-9a0b-87b217f4fa03 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.494878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.500404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb916b-fbc4-4503-9bdb-f766996c5324 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.524196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.526035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.526390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.526961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.527723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.530057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.540195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.541504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.541866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.542232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.543168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] RBAC: Adding query filter params (name=network) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:01.543858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.545361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.551262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 408/822] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:01.552011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.555930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 415/823] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:01.558088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.631419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.693536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411093ef-e4c2-4a1a-922e-82d355a54032 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.722348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2358b-d106-4631-a78a-72397e74bce9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.747440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.748473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.748994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.749531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.750578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:01.751075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.753035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.780508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 409/824] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:41:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:01.782321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.783080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.783443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.783815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.788023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:01.788023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.788260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.788337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.793133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 416/825] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:01.801933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:01.838678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.934039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4e5e-317e-4248-bbaf-86ef850a4fb7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.944476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154380-8c78-4b3e-b578-c275fcfaac82 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:01.973586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.974263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.974530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.974852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:01.975603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:01.977324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:01.979900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:01.991109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:01.991725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:01.992465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:01.992465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.003502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 417/826] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:02.085011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:02.086465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:02.225929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 410/827] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:02.232592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:02.372504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:02.397548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d76ce-c1de-4e8b-9fdc-be428c7f9b22 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:02.434415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:02.435216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.435498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.435772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.446550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:02.448814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:02.468321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:02.469241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:02.470553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:02.470553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:02.470553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:02.470553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:02.470553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 418/828] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:02.476625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:02.514603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:02.600150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1151a-56e0-417f-89e3-1d83c9f3b0b2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:02.644799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:02.645469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.645752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.646030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.646754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:02.647058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:02.648451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:02.661862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 411/829] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:02.667924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:02.774038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012694d-e801-4f2e-8812-abfcb12fe58e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:02.804983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:02.811134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:02.812169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.812636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.813149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.820273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:02.821825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-52a4c5d5-c7bc-4b17-9ef0-d5655e1275ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:02.837187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:02.838174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:02.839059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:02.843054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 419/830] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:02.844423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:02.856031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14961c-ee14-41a1-9555-331fbac6c9a5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.856353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14961c-ee14-41a1-9555-331fbac6c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.856639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14961c-ee14-41a1-9555-331fbac6c9a5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.858124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 420/831] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:41:02.865875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.866166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.866441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.889912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:02.891919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:02.958430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:02.972466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 421/832] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:02.976150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5a3c-2cdb-4e9a-9ed6-110012d3e0ca None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:02.991068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.017545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.018841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.019783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.020595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.021950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:03.022890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.025175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.047043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 412/833] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:03.049143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.118491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a615eb9-e889-4e91-9d68-00a0b68bb7ce None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.148177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.163007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.163972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.164292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.164572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.180400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:03.186421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339c84-65af-4473-bcc4-8b631ab5216e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:03.188785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:03.189893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:03.191140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 422/834] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:03.199703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.238595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.239494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.239928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.240377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.241351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=11d05026ac51451a8c10fb63f840d15f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:03.241839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.243993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.259121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 413/835] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/role_assignments?user.id=11d05026ac51451a8c10fb63f840d15f&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:03.316117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3998-48af-494d-8714-4ed6d00d4477 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.354329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.355010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.355291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.355565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.356356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:03.356662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.358066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c8c3e-b916-427a-b050-869ec69b2736 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.368121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 423/836] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:03.374347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.388104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.460985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4761a-b568-4064-8b10-3c8c92c06e84 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.461342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4761a-b568-4064-8b10-3c8c92c06e84 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.461546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4761a-b568-4064-8b10-3c8c92c06e84 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.463249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 424/837] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:03.469302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.469695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.470089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.492132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:03.492743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:03.498570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6aa5-97fd-4ee3-8a49-69e488655bda None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.541274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.542076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.542364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.542643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.549348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.556956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.558755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:03.579024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:03.579928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:03.580870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:03.580870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:03.580870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:03.580870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:03.583133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 414/838] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:03.583392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 425/839] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:03.592106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.608015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.659452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.704524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364c92d-a63f-4f94-b940-d1ea7493d0d3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.740986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435a36c-bc37-4e16-9349-30b8bf020897 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.761744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.763267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.764036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.764824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.766647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:03.767471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.770403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.780853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.781703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.781976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.782235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.793472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 415/840] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:03.794002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:03.804104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:03.804295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:03.805226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:03.806113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:03.808733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 426/841] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:03.814381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.863820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.942627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ca74-c01f-47bd-99ad-d4bd3a77cdf8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.947691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49904fe8-339c-481e-9308-d1933f4f6434 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.982021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.982715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.982981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.983149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.983307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.984001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:03.984368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.985858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531a79-d19e-4721-a452-8eb7cb41375b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.997271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 427/842] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:03.997271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae46ba-0b94-4623-8a67-288c1089d3e2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.997271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae46ba-0b94-4623-8a67-288c1089d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.997271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae46ba-0b94-4623-8a67-288c1089d3e2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.998116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 428/843] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:04.003338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae46ba-0b94-4623-8a67-288c1089d3e2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.015139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.016210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.016666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.017014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.027498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.028982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-10c22ec8-1eea-415e-9f6c-dcd2649f5396 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:04.044877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:04.045859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:04.046825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 416/844] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:04.048321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.048321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.048321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.066172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:04.067359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:04.112226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.122790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae46ba-0b94-4623-8a67-288c1089d3e2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.143142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 417/845] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:04.144161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.166228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.167089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.167377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.167655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.179587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.181068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:04.200344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:04.201281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:04.202193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:04.202193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:04.202193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:04.202193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:04.202193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 429/846] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:04.203116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.251206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fc57f-1bff-4552-ae7e-b2db145af7fa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.264264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.288606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.289269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.289553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.289832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.290654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:04.291487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.293386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.317808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 418/847] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:04.318649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.319469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b08aa8-50bb-411e-9d25-8d128181352f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.356600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.357404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.357687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.357964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.358614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.359973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:04.372781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:04.373786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:04.374643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 430/848] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:04.375462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.392133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.430919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ed7d2-0d59-4b4d-9ae0-7e43ad6a30f3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.465515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.466199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.466495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.466757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.467473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:04.467780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.469168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.480893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 419/849] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:04.481705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.486960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf63ee1-ddd7-40bc-92a8-077e349d39dd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.514045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.523468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.524177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.524465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.524744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.594845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6eec-67fb-43ff-b28b-dde60d918a45 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.633530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.634122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.634408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.635249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.635977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:04.636311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.637707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.647516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 420/850] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:04.647516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.715465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.716917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.729842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.746085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.754695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951e5c-1e65-4b81-bf8c-a6d020cb9a20 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.794093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.794928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.795166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.795446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.803271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.807137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.820750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 431/851] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:04.820750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:04.822217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:04.823401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 421/852] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:04.824427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:04.934559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503efb9-8805-4771-8aa1-6351990d93f6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.935142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a61d-3b00-4a22-a974-2f1f9c583f0c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:04.949601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:04.971544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.971726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:04.972371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.972480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:04.972671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.972771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:04.972919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.973012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:04.973651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:04.973933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.975277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.980249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 432/853] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:04.984838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:04.986316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:04.989951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:05.013554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:05.014531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:05.015410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:05.015410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:05.015410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:05.015410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:05.022889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 422/854] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:05.025778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.038201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.132207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc63d-2e0c-4b23-8271-8925efc32338 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.154557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11562ad1-e1ff-4ae1-96bd-aa74b8f2aef6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.180035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.180729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.181009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.181288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.182894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:05.183204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.185408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.202688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.203508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.203923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.204237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.204965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:05.205270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.206636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.207084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 433/855] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 14 10:41:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:05.214538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.226447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 423/856] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:05.232421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.259101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.318489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.356612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8cd85-a2c6-46e1-bfe1-4d1451d17ea1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.359825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e9319-5394-4dfd-8842-01095c80f013 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.396244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.397420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.397543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.397925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.403181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e34848-7fef-464e-ba42-8037b4304a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.404022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34848-7fef-464e-ba42-8037b4304a5a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.404785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34848-7fef-464e-ba42-8037b4304a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.405229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e34848-7fef-464e-ba42-8037b4304a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.405564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.407113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:05.422994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:05.424194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:05.425323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:05.432102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 424/857] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:05.435958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.486151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34848-7fef-464e-ba42-8037b4304a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.487601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e34848-7fef-464e-ba42-8037b4304a5a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.521939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.550057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125f37-4e61-4f9e-98de-55ccdc93edeb None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.577380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.587375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.588077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.588406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.588689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.589478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:05.589789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.591216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.593016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 434/858] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:05.594186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25facc5-bfa4-45b3-a5b2-cda01c2988c7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.594473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25facc5-bfa4-45b3-a5b2-cda01c2988c7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.594751 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25facc5-bfa4-45b3-a5b2-cda01c2988c7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.600268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 435/859] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:05.601139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.601422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.601700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.616808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 425/860] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:05.617561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.619324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:05.620547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:05.688184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 436/861] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:05.688953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.733960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0cb0-4f31-42c0-9843-b6f3ade6b2de None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.766588 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.773434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.774327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.774617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.774896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.785713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.787161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:05.804618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:05.805486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:05.806894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:05.806894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:05.806894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:05.806894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:05.806894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 426/862] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:05.807168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.809790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9707dc-a666-4715-859b-f236c8d02864 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.846934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.847571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.847859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.848160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.848987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=55723830ec2c4ccab79e51f19c58b3bf) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:05.849305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.850714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.856640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 437/863] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/role_assignments?user.id=55723830ec2c4ccab79e51f19c58b3bf&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:05.857330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.861963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.942488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c167ca7-aabd-402e-9ce4-d72b3cc602e7 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.982097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.982951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.983233 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.983510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.984235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.985630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:05.999302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:06.000380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:06.001228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 427/864] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:06.006433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1c71c-4b1c-4452-9d7b-f4decd215e55 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.009251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.037239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:06.048699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.049688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.050286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.050580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.051606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:06.051938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.053510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.072055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 438/865] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:06.080905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.154419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f290941-2d52-4067-819a-a50524693de2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.156285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:06.201816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7c487-142b-444e-b088-1802a1f8ab16 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.205656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.206328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.206612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.206888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.207601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:06.207908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.209836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.216824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 428/866] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:06.221952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.247704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.248525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.248809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.249619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.259004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.261111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:06.278590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:06.279530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:06.280431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 439/867] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:06.288790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.336541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a33a2e-200f-4163-8191-099800d8c70e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.342397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:06.375694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.376745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.377230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.377726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.378780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:06.379092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.380473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.385553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 429/868] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:06.398047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa15c00-a54a-4492-87a7-4add5208074f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.439424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.440127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.440414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.440691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.441514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:06.441807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.443272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb20df2-ba29-424b-a056-61a58f44d6a5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.458325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 440/869] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:06.464899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.501433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:06.583716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0b79-f8b9-4ed0-ba00-e2b301a3ddc8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.620474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.621139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.621425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.621706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.622540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=eac24ebb573140718662633d85735b71) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:06.622854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.624324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2b31c-b5b3-433f-9d10-bfd078271ea7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.630848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 430/870] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/role_assignments?user.id=eac24ebb573140718662633d85735b71&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:07.099456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff69b-98b0-4bb5-89e0-d803bf96ee5e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:07.099995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff69b-98b0-4bb5-89e0-d803bf96ee5e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:07.099995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dff69b-98b0-4bb5-89e0-d803bf96ee5e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:07.101651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 441/871] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:07.107301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b4df-7936-4a2e-9eed-73835c05123c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:07.107749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b4df-7936-4a2e-9eed-73835c05123c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:07.107828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b4df-7936-4a2e-9eed-73835c05123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:07.125132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2fa5b4df-7936-4a2e-9eed-73835c05123c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:07.126238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2fa5b4df-7936-4a2e-9eed-73835c05123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:07.196488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 431/872] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:07.219479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff69b-98b0-4bb5-89e0-d803bf96ee5e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:07.323051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dff69b-98b0-4bb5-89e0-d803bf96ee5e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:07.332390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:07.358274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb171-0e5f-4a87-8a13-c454afc5e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:07.358936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb171-0e5f-4a87-8a13-c454afc5e2d9 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:07.359210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb171-0e5f-4a87-8a13-c454afc5e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:07.359481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb171-0e5f-4a87-8a13-c454afc5e2d9 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:07.360245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecb171-0e5f-4a87-8a13-c454afc5e2d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:07.361591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecb171-0e5f-4a87-8a13-c454afc5e2d9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:07.377660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 442/873] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:07 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:08.079275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5012-cb76-44cf-85ce-85598338dae7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.079562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5012-cb76-44cf-85ce-85598338dae7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.080146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5012-cb76-44cf-85ce-85598338dae7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.081979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 432/874] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:08.087451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.088584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.089068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.106085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:08.108027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:08.187438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 443/875] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:08.210741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5012-cb76-44cf-85ce-85598338dae7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.236947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.315096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5012-cb76-44cf-85ce-85598338dae7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.349827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb3489-54b6-4a68-935b-1c8e8afa9425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.350634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3489-54b6-4a68-935b-1c8e8afa9425 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.350913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3489-54b6-4a68-935b-1c8e8afa9425 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.351188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb3489-54b6-4a68-935b-1c8e8afa9425 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.362333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb3489-54b6-4a68-935b-1c8e8afa9425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-fceb3489-54b6-4a68-935b-1c8e8afa9425 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:08.371052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:08.371980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:08.372865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 433/876] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:08.379877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.484565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.494293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb849cc-1d78-4206-9a55-b269db80f714 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.519303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad8fa-cd86-4628-a67a-ef8c0decef1c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.519955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad8fa-cd86-4628-a67a-ef8c0decef1c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.520349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad8fa-cd86-4628-a67a-ef8c0decef1c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.522162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 434/877] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:08.528649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.529015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.529373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.534319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.536187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.536665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.536944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.537703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:08.538018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.539378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.548444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 444/878] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:08.551023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:08.556123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:08.557227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.630195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 435/879] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:08.647982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.663897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.670217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53955c-9d17-47db-9ba8-bb1e8c05cb1b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.717351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.718551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.719314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.719799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.735084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.737842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.755500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6e74-9bba-4e8f-921f-55b07b7c72a8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5bed70a2-a965-42db-9a90-0651ba061f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:08.760739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:08.761581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:08.762446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:08.762446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:08.762446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:08.762446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:08.762446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 445/880] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:08.764242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974433-92ac-4ff6-920f-0c4edfabaacb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.764242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974433-92ac-4ff6-920f-0c4edfabaacb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.764242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974433-92ac-4ff6-920f-0c4edfabaacb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.765917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 446/881] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:08.768091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974433-92ac-4ff6-920f-0c4edfabaacb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.779843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.795171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9a99a-1dbe-4eb6-a33a-716cf37b748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.795839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9a99a-1dbe-4eb6-a33a-716cf37b748b None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.796166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9a99a-1dbe-4eb6-a33a-716cf37b748b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.796458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9a99a-1dbe-4eb6-a33a-716cf37b748b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.797182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9a99a-1dbe-4eb6-a33a-716cf37b748b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.798554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9a99a-1dbe-4eb6-a33a-716cf37b748b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.813290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 436/882] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:08 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:41:08.814508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.814799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.815082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.838734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:08.840488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:08.943491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974433-92ac-4ff6-920f-0c4edfabaacb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.944637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 437/883] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:08.973405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.977533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.992193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.993177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.993462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.994243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.995125 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:08.995565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.997144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.013965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 447/884] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:09.019509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.093323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced1a4-8e01-48b8-af0d-6b04fd3b1673 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.095258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.136609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a67f5-850d-4cac-9079-add4ba6263c9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.141991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.142874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.143223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.143562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.144315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.146240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:09.163904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:09.165178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:09.166185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:09.168222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 438/885] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:09.173042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.179557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.180528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.180925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.181347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.189211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.190846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:09.208574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:09.210004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:09.211924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:09.217161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 448/886] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:09.218096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.252478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.300919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a25c-b0aa-4536-99b1-416dcb91c950 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.328210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d3a78-b721-4e39-98fa-691659f03a51 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.347865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.348563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.348846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.349122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.350309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:09.350676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.352293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.360679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 439/887] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:09.360895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.364935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.374616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.375573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.376611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.377095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.378590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:09.379106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.381507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.406797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 449/888] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:09.413168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.485816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a32722-40b0-41bc-8381-cf0f4d0ab68d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.518847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.521069 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966078-d41e-4313-9126-3a2d744707ea None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.526826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.527497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.527778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.528054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.528787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:09.529092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.530855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07cad0-00dd-4cbe-821e-2e76835db95d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.536326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 440/889] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:09.537544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872940-7578-49b7-b416-9a23d6822bd4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.537826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872940-7578-49b7-b416-9a23d6822bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.538128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872940-7578-49b7-b416-9a23d6822bd4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.539530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 441/890] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:09.545231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.545524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.545806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.564815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:09.566082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:09.568594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.569484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.569771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.570052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.625825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.649191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.651345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.660354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 442/891] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:09.681885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.782781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 450/892] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:09.789284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.791160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685e97-c58a-4a28-82db-230cef0205fd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.819562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.829784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.830588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.830875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.831154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.831810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.833250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:09.847052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:09.848292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:09.849156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 443/893] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:09.859337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:09.897557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:09.917404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be7918-e92f-4dd8-b331-2df8c3ab397b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.953716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:09.954513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:09.954791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:09.955062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:09.965791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:09.967238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:09.974208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cf510-f4fa-40e0-8a09-06041860427f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:09.985843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:09.986780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:09.987662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:09.987662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:09.987662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:09.987662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:09.987662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 451/894] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:09.992593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.020155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.021436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.021911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.022362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.023245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:10.024209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.026611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.038012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 444/895] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:10.039025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.105747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:10.120868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2c81-2c41-47dd-9726-8c7846c9f58f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.162685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab992b13-ef35-4483-9ac6-0aeaa57a0ee1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.167972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.169183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.169610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.170066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.171540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:10.171996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.174346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.176508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:10.192271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 452/896] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:10.197710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.206487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.207151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.207430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.207703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.208437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:10.208742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.210621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.218252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 445/897] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:10.223015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.325967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a7bf1-3af2-4530-bbf8-f882addf82a7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.336896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf84d32-c07c-40a7-b314-cef7a5ce79bd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.361696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:10.361877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.362695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.363173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.363297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.372904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.374473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.384011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.385067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.385568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.386038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.387008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] RBAC: Adding query filter params (interface=public, service_id=e77ef4ac805e45208dabf6174f715931, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:10.387506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.389064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:10.389972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:10.390823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:10.391701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 453/898] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:10.397790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.404627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 446/899] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:41:10 2022] GET /identity/v3/endpoints?service_id=e77ef4ac805e45208dabf6174f715931&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:10.410176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.460078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:10.509752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77543955-0021-460c-aaca-eac7ebbd366b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.513695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d256b-e876-4e92-9155-4bdc80a31207 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.547050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.547812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.548117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.548395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.549229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:10.549794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.550455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd93e64-070c-437c-8a5e-ea40272a8b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.551346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd93e64-070c-437c-8a5e-ea40272a8b8a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.551539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.552012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd93e64-070c-437c-8a5e-ea40272a8b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.552526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd93e64-070c-437c-8a5e-ea40272a8b8a None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.553407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd93e64-070c-437c-8a5e-ea40272a8b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.554957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd93e64-070c-437c-8a5e-ea40272a8b8a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.568086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 454/900] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:10.568289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 447/901] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:41:10 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:41:10.574828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:10.691981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcec037-783d-4d4b-a37b-2c677fc03ca5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:10.708470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:10.730581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:10.731244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.731577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.731862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.732726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] RBAC: Adding query filter params (role.id=897b421494104cfc8c32e1c9b8a8733e, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=55723830ec2c4ccab79e51f19c58b3bf) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:10.733047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:10.734509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed881386-8672-4ade-95a7-ad1795afb519 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:10.741297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 455/902] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:10 2022] GET /identity/v3/role_assignments?user.id=55723830ec2c4ccab79e51f19c58b3bf&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=897b421494104cfc8c32e1c9b8a8733e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:10.957605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832eda0-f8f0-49f0-b6f7-6f969311273d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.957912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832eda0-f8f0-49f0-b6f7-6f969311273d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.958092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832eda0-f8f0-49f0-b6f7-6f969311273d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.959570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 448/903] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:10.964984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.965555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.966060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.983234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:10.984728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:11.055434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 456/904] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:11.078118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832eda0-f8f0-49f0-b6f7-6f969311273d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.127618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.183746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832eda0-f8f0-49f0-b6f7-6f969311273d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.218790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.219890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.220351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.220767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.221576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.223139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:11.236176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:11.237343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:11.238364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:11.240966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 449/905] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:11.247456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.349975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14324e-c1cd-4b6b-b0a0-a2c067303aa1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.359634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.385684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.386342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.386619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.386893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.387586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:11.387890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.389271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.394218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 457/906] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:11.401634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.505592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b32ea-4979-4ec6-ae5b-d5ae90f1d845 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.517053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.542788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.543449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.543735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.544012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.544751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:11.545060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.546427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789b6d-1ad1-4538-95b8-64f93187353e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.551755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 450/907] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:11.557619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.663247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27c201-15c5-4d13-9b3c-28cda0f92340 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.666279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125598-880e-4591-ac69-d09b3fc58a39 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.666567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125598-880e-4591-ac69-d09b3fc58a39 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.666842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125598-880e-4591-ac69-d09b3fc58a39 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.672154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 451/908] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:41:11.673582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.673868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.674142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.693050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:11.694229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:11.702466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.703123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.703460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.703846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.704716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] RBAC: Adding query filter params (interface=public, service_id=12a5cf659cff45c3bda9a627b39ce0c2, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:11.705027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.706487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.712385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 458/909] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/endpoints?service_id=12a5cf659cff45c3bda9a627b39ce0c2&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:11.717852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.766231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.769507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 452/910] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:11.793169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.848020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54e43-3f41-4b43-b29a-b42b934a3a23 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.899466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f317-48de-4ef1-8160-b328478eece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.900857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f317-48de-4ef1-8160-b328478eece7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.901146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f317-48de-4ef1-8160-b328478eece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.901490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f317-48de-4ef1-8160-b328478eece7 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.902294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f317-48de-4ef1-8160-b328478eece7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.903760 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f317-48de-4ef1-8160-b328478eece7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.908120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d52030-1eaf-4d0f-a084-79f37f6a4772 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.916178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 459/911] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:41:11.940281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.952770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789054bf-28c6-45f4-a1bf-0583a6aa98c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.953454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789054bf-28c6-45f4-a1bf-0583a6aa98c6 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.953736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789054bf-28c6-45f4-a1bf-0583a6aa98c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.954011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789054bf-28c6-45f4-a1bf-0583a6aa98c6 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.954918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789054bf-28c6-45f4-a1bf-0583a6aa98c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.956523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789054bf-28c6-45f4-a1bf-0583a6aa98c6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.980410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 453/912] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:11 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:41:12.734193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972df20-d131-472c-8cd0-7b933180fa90 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:12.734716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972df20-d131-472c-8cd0-7b933180fa90 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:12.734795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972df20-d131-472c-8cd0-7b933180fa90 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:12.736488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 460/913] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:12.741807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3994f3-c706-4a68-af8e-e0973da200a6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:12.742284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3994f3-c706-4a68-af8e-e0973da200a6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:12.742362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3994f3-c706-4a68-af8e-e0973da200a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:12.760948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9d3994f3-c706-4a68-af8e-e0973da200a6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:12.762151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9d3994f3-c706-4a68-af8e-e0973da200a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:12.836303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 454/914] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:12.858958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972df20-d131-472c-8cd0-7b933180fa90 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:12.910526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7c46-8a6f-41f3-b248-90fcaf62670e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:12.910842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7c46-8a6f-41f3-b248-90fcaf62670e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:12.911091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7c46-8a6f-41f3-b248-90fcaf62670e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:12.912733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 455/915] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:12.919522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:12.920033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:12.920536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:12.938051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:12.939630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:12.971393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:12.975451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972df20-d131-472c-8cd0-7b933180fa90 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.013950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.014669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.020152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.020152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.020152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.020152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.020930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 456/916] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:13.029429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:13.030374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:13.031182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 461/917] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:13.036583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.041583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.062245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:13.150825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8285537-1c64-4c41-87d3-adf14e0d1769 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.151815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6b847-c14e-43b1-ae57-67ecefb3ba38 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.188393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.188820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.189646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.189755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.189931 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.190201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.190604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.191068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.192081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:13.192590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.194197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.200164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 457/918] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:13.201179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:13.211540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:13.211692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:13.213336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:13.214156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:13.216128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 462/919] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:13.217045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.244758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:13.326067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4e0f-6719-4e75-b205-93afb7a194fe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.327455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:13.348326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90df84b-7afd-44f7-85d6-863a9fa849c0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.369693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.370541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.370966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.371779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.372854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:13.373401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.375360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.386212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 463/920] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:13.388967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.389852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.390262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.391643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.392178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.393052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:13.393475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.395131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.402172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 458/921] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:13.407561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.499964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:13.516792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76d907-7872-4e4e-b872-e242aba6544a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.532520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e23056-3345-4051-a9a9-7f2d9c833d4f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.553641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.554470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.554776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.555402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.567544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.569009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.571118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.572217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.572706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.573410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.574324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.575941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:13.588091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:13.589102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:13.590371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:13.590371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:13.590371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:13.590371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:13.590371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 464/922] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:13.595859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.599654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 459/923] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:13.717087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbb6b9-55fc-4ac8-8121-02eb37df5e41 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.767302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.768100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.768298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.768581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.769322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:13.769633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.771022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.772905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:13.785860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 465/924] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:13.791713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:13.795644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:13.898225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d61e87-c2a1-4e62-abbf-3c2bb85aa1de None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:13.933651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:13.934468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:13.934758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:13.935035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:13.942981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:13.944521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0a0e4875-2b4e-455a-aeb9-a079488de287 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:13.959753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:13.960794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:13.961731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 460/925] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:13.969061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.036524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c17b-ce81-487e-bd29-61b8cd78e496 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.036835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c17b-ce81-487e-bd29-61b8cd78e496 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.037092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c17b-ce81-487e-bd29-61b8cd78e496 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.038590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 461/926] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:14.045796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193d9e9-5232-4e1f-836b-537767ba1213 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.046343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193d9e9-5232-4e1f-836b-537767ba1213 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.046828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193d9e9-5232-4e1f-836b-537767ba1213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.064807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f193d9e9-5232-4e1f-836b-537767ba1213 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:14.066342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f193d9e9-5232-4e1f-836b-537767ba1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:14.081696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8400838-8d37-45a6-b161-8226a2818114 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.118338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.118963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.119239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.119510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.120394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:14.120705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.122304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.129123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.147659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 462/927] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:14.147836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 466/928] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 14 10:41:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.147917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185181e-b532-4183-8a17-8ab60d16c7cd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.147917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185181e-b532-4183-8a17-8ab60d16c7cd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.147917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185181e-b532-4183-8a17-8ab60d16c7cd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.147917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 463/929] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:14.148229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.148311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.148311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.148311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.166137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:14.167456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:14.208322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.240715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 464/930] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:14.241559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.262965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971686-bc5d-414e-a169-81ef7ba23ce5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.297097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.297878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.298153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.298420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.309892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.312561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:14.331537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:14.332743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:14.333678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:14.333678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:14.333678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:14.333678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:14.337506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 467/931] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:14.337506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.362729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5ff6-51b8-443d-bc39-5591ba8122eb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.387676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.401230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.402208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.402547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.402915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.403575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.404965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:14.418589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:14.419598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:14.420812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 465/932] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:14.421678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.448914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01840ec-e891-46a5-aec1-97a65e324e81 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.451257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.485650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.486439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.486724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.487153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.487649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.489037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:14.502148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:14.503465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:14.504486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 468/933] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:14.505254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.539893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71f440-3270-411b-aab1-a503d180da66 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.576554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.577212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.577501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.577784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.578509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:14.578823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.580209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.596650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 466/934] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.596650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.610223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba0130-010e-4a27-a8f0-3629ef0cf999 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.646818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.647237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.647424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.647688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.647965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.649046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:14.649380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.651077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.660683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 469/935] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.660683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.692743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.705759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b9c88-13a7-4d91-a9cf-7044d59ce167 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.744299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.745021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.745311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.745646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.746364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:14.746677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.748031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.757488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 467/936] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.757488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.771573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfae06-1404-4c35-ada6-c282f2f271a3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.807257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.808084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.808394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.808651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.815558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.817030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:14.832595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:14.833600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:14.834467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 470/937] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:14.835468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.869195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926913a-49d5-43da-a50b-02379a68d88b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.891347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.916577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.917239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.917518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.917789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.918491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:14.918806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.920256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.926139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 468/938] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.927124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.946543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.956695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc6e9-04d4-44be-a580-aa3600b6abe7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.993834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.994668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.994919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.995267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.996041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:14.996440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.997868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:15.003623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 471/939] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:15.008827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:15.036718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3099d-24fd-4502-8520-7727a6b4c2b2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:15.073852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:15.074509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.074806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.075056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.075828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:15.076286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:15.077691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:15.095058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 469/940] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:15.095919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:15.117904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6ffbd-8572-43a1-ad67-d9fa0f4b7c1e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:15.133971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:15.154986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:15.156089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.156377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.156677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.157400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:15.158771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:15.179745 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 472/941] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:15.185069 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:15.209836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:15.213749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccaa43-ebc9-4533-8489-6895957e9371 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:15.268252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:15.269275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.269723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.270421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.271436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] RBAC: Adding query filter params (interface=public, service_id=757f9f6cef8d4888a81d16b729fdd51c, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:15.271924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:15.273587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:15.286028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 470/942] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:41:15 2022] GET /identity/v3/endpoints?service_id=757f9f6cef8d4888a81d16b729fdd51c&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:15.287649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:15.347949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3063-871b-4f41-ab5c-1d675b11ea50 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:15.387891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b0a08-3093-408d-9969-6910e5237224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:15.389106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0a08-3093-408d-9969-6910e5237224 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.389595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0a08-3093-408d-9969-6910e5237224 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.390014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0a08-3093-408d-9969-6910e5237224 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/55723830ec2c4ccab79e51f19c58b3bf/roles/897b421494104cfc8c32e1c9b8a8733e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.392524 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0a08-3093-408d-9969-6910e5237224 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=55723830ec2c4ccab79e51f19c58b3bf, role_id=897b421494104cfc8c32e1c9b8a8733e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:15.394135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0a08-3093-408d-9969-6910e5237224 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:15.401884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:15.409810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc012d-4d4d-4052-97c0-a3995d1107f9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:15.416143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 473/943] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:15 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/55723830ec2c4ccab79e51f19c58b3bf/roles/897b421494104cfc8c32e1c9b8a8733e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:15.454460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9f07a-9206-43aa-a817-b89c9d1c5665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:15.455243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9f07a-9206-43aa-a817-b89c9d1c5665 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.455630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9f07a-9206-43aa-a817-b89c9d1c5665 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.456007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9f07a-9206-43aa-a817-b89c9d1c5665 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.456827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9f07a-9206-43aa-a817-b89c9d1c5665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:15.458965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9f07a-9206-43aa-a817-b89c9d1c5665 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:15.472103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 471/944] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:41:15 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:41:15.819258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579129-cc3a-48fd-8df2-f2c303d44171 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.819746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579129-cc3a-48fd-8df2-f2c303d44171 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.819746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579129-cc3a-48fd-8df2-f2c303d44171 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.821433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 474/945] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:15.827510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:15.827806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:15.828110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:15.845417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:15.846622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:15.919350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 472/946] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:15.942624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579129-cc3a-48fd-8df2-f2c303d44171 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:16.020215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:16.052442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579129-cc3a-48fd-8df2-f2c303d44171 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:16.086851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:16.087511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.087792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.088087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.088807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:16.090218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:16.091561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING keystone.server.flask.common [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 10:41:16.111827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.sql.core [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:41:16.111827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 10:41:16.111827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [parameters: {'id': '72759dc1af3044f28c8409e5ea3af004', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 10:41:16.111827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80168) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 72759dc1af3044f28c8409e5ea3af004.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 72759dc1af3044f28c8409e5ea3af004. Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:41:16.119960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 10:41:16.121092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application yield resource Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise self.value Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application session.commit() Jul 14 10:41:16.122059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:41:16.123570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:41:16.125794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:41:16.127709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [parameters: {'id': '72759dc1af3044f28c8409e5ea3af004', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:16.129787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:16.131601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 72759dc1af3044f28c8409e5ea3af004. Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:16.133772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 475/947] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 14 10:41:15 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:16.135445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:16.227693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:16.238486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca6322-e2eb-44ce-bb9f-01bd375ce197 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:16.277612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:16.278469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.278752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.279028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.285875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:16.287311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-90f66b03-6f1b-45a3-be70-91f6fd6ee34e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:16.301811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:16.302886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:16.303981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 473/948] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:16.311031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:16.412276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9841-a82c-4080-aece-7c79b815b596 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:16.438773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:16.446859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:16.447661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.448593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.448970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.449840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:16.450361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:16.452426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59078238-ee1d-4ee2-ae09-917232b1da2c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:16.480199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 476/949] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:17.412810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c425-55d3-412c-a207-83ca5a796a30 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.413342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c425-55d3-412c-a207-83ca5a796a30 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.413342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c425-55d3-412c-a207-83ca5a796a30 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.415016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 474/950] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:17.420741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.421152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.421322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.439312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:17.440857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:17.510963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 477/951] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:17.529206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844c40-967c-4d72-a073-edec192538cb None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.529518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844c40-967c-4d72-a073-edec192538cb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.529766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844c40-967c-4d72-a073-edec192538cb None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.531386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 475/952] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:17.533514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:17.536296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a10d-f2ea-4c20-8df5-1a6e41b7848b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.536582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a10d-f2ea-4c20-8df5-1a6e41b7848b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.536865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a10d-f2ea-4c20-8df5-1a6e41b7848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.554269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f876a10d-f2ea-4c20-8df5-1a6e41b7848b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:17.555464 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f876a10d-f2ea-4c20-8df5-1a6e41b7848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:17.632969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 476/953] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:17.635142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0fd16-4094-49c4-9bd1-9215f00310cc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.635637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0fd16-4094-49c4-9bd1-9215f00310cc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.636182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0fd16-4094-49c4-9bd1-9215f00310cc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.641873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 477/954] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:17.643215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.643914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.644527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.647562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a884eb-7a69-49cf-b42b-8553f15ee77e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:17.663573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:17.664715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:17.668576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:17.687377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:17.688213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.688501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.688779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.689434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:17.690788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:17.703316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:17.704659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:17.705576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 478/955] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:17.706413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:17.738490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 478/956] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:17.739177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:17.751266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:17.823829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b8d2-9b81-4a8d-80bb-f79de202deb7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:17.843563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4007-ee77-453a-9ce7-abfd53b14915 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:17.857713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:17.858524 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.858806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.859084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.872765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:17.880993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:17.881928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:17.882768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 479/957] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 14 10:41:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:17.883488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:17.891114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:17.892642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:17.892933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:17.893220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:17.893936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:17.894250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:17.895607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:17.901721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 479/958] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:17.902380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:17.938557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:17.979279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.003917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bbc69-cbed-434b-9e0a-1da9bf13fed2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.005380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a5f60-dc8d-4c1b-b2ae-76d4d184b772 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.039714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.040538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.040828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.041111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.041402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.041869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:18.042184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.042279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.042482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.042761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.043413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.043578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.044802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.052104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 480/959] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:18.052759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:18.062295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:18.063487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:18.064663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 480/960] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:18.065498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.168819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80916-eda4-47e3-a053-539fc1b0d1aa None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.172207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fffe16-d78d-411d-9247-1c865acf1dba None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.179518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.204971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.205561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.205844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.206121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.206831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:18.207141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.208537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.210510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.215544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.216418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 481/961] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:18.216844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.217313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.217447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.217895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.231836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.233678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:18.254454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:18.255427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:18.256354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:18.256354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:18.256354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:18.256354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:18.258953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 481/962] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:18.265083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.366503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d8f5-003f-4e74-b144-11c0c43ade60 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.408097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d8b89-4eca-4659-8af1-e3838441bee1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.416272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.417048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.417406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.418036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.418761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:18.419389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.421109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.427148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 482/963] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:18.433022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.447520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.448736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.448736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.449009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.449741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:18.450045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.451418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.464559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 482/964] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:18.470114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.489691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.507679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.548940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12ea6-6694-4dbc-aa36-fb710984d231 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.579569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6150e-bf92-4aa4-9e20-efde969170a5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.590571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.591339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.591624 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.591900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.592650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:18.592958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.594548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67608f-a52f-44d8-990f-c8060d14e844 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.604218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 483/965] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:18.606093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7844c9-7660-4547-a035-5d1f765033a2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.606382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7844c9-7660-4547-a035-5d1f765033a2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.606661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7844c9-7660-4547-a035-5d1f765033a2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.608039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 484/966] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:18.608794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7844c9-7660-4547-a035-5d1f765033a2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.617686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.618535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.618825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.619108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.627582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.629049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b986dc30-0509-4881-a7f6-41577ce03fc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:18.644355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:18.645350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:18.646325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 483/967] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:18.646952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.647028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.647733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.664346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:18.665587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:18.733101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7844c9-7660-4547-a035-5d1f765033a2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.740110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 484/968] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:18.740110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.746068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.776202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:18.785039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.785696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.785977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.786239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.786965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.788401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.808346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 485/969] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:18.809070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.877570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472cb0f-e0b2-474e-9ae3-66b69585ebff None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.932833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1446d6-2f03-4693-bbb1-0f102234375f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:18.943097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.944736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.945752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.946255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.948467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:18.949333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.951957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.973714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483db3-f041-497a-834f-86971c968c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:18.974393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483db3-f041-497a-834f-86971c968c4b None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.974674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483db3-f041-497a-834f-86971c968c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.974946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483db3-f041-497a-834f-86971c968c4b None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.976219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db483db3-f041-497a-834f-86971c968c4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:18.977102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db483db3-f041-497a-834f-86971c968c4b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:18.979243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING keystone.server.flask.common [None req-db483db3-f041-497a-834f-86971c968c4b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 10:41:18.985583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 485/970] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:18.986477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:18.993158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.sql.core [None req-db483db3-f041-497a-834f-86971c968c4b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:41:18.993158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 10:41:18.993158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [parameters: {'user_id': 'ef2d82626d464cee952068edf309c4f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 10:41:18.993158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-db483db3-f041-497a-834f-86971c968c4b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Jul 14 10:41:19.010502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:41:19.011475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application yield resource Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise self.value Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application session.commit() Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:41:19.012490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:41:19.013377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:41:19.014292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application result.read() Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:41:19.015149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ef2d82626d464cee952068edf309c4f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:19.015966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 10:41:19.017421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:19.018847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 486/971] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 14 10:41:18 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:19.026156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483db3-f041-497a-834f-86971c968c4b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.066081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.084278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.113270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1213086-89c5-4a0c-9600-0561bd2f7641 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.150352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.151011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.151298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.151579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.158646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483db3-f041-497a-834f-86971c968c4b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.206002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.206796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.207076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.207779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.218208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.220121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.224699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.226149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:19.237551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:19.238493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:41:19.239434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:19.239987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 487/972] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:19.245176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.316427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.354344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606e389-b20e-4e56-8b57-ca1f627b576a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.357405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.364180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 486/973] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:19.369073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.395141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.396231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.396741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.397321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.398451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:19.398963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.401379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.445522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 488/974] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:19.489460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e252aa-72e4-4f52-942b-8e2b28bcf04c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.532346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.533161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.533448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.533723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.545740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.547211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:19.567271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:19.568269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:19.570075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:19.570075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:19.570075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:19.570075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:19.570075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 487/975] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:19.577225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.685208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b961a-19c6-4207-a9ba-d6b57c417129 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.722936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.723603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.723936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.724257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.724986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:19.725298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.726664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.739233 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 489/976] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:19.745748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.761230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.847491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a786-c52c-4137-a54c-d7ffa58320f2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.884513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.885308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.885586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.885859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.893707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.895145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:19.912598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:19.913531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:19.914430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:19.916132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 488/977] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:19.920471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.944214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:20.025729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4028-7330-47ce-8d16-72f46cda1551 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:20.060581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:20.061245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.061528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.061803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.062590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:20.062901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:20.064344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7a559-5d7b-4b1b-bbc5-22b205169018 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:20.080218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 490/978] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:20.083523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:20.159519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:20.186075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfacb-6cc8-4fff-9073-a7285e41bf55 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:20.219642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:20.220322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.220615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.220893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.221723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] RBAC: Adding query filter params (role.id=897b421494104cfc8c32e1c9b8a8733e, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=55723830ec2c4ccab79e51f19c58b3bf) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:20.222036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:20.223470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c319d-e9a2-4a16-b2b8-7e0fb9fdad5b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:20.230255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 489/979] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:20 2022] GET /identity/v3/role_assignments?user.id=55723830ec2c4ccab79e51f19c58b3bf&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=897b421494104cfc8c32e1c9b8a8733e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:20.324351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d951-635f-4d54-b6af-e1b93807c16a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.324646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d951-635f-4d54-b6af-e1b93807c16a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.324834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9d951-635f-4d54-b6af-e1b93807c16a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.326373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 491/980] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:20.331639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83fa49-c03e-4bfb-b24c-031f55fbc958 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.331914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83fa49-c03e-4bfb-b24c-031f55fbc958 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.332218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83fa49-c03e-4bfb-b24c-031f55fbc958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.349545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ea83fa49-c03e-4bfb-b24c-031f55fbc958 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:20.350746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ea83fa49-c03e-4bfb-b24c-031f55fbc958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:20.422708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 490/981] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:20.444928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d951-635f-4d54-b6af-e1b93807c16a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:20.529208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:20.550180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9d951-635f-4d54-b6af-e1b93807c16a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:20.584845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b422dc-15c0-4923-abb5-941ae5520003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:20.585429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b422dc-15c0-4923-abb5-941ae5520003 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.585710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b422dc-15c0-4923-abb5-941ae5520003 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.585982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b422dc-15c0-4923-abb5-941ae5520003 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.586699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b422dc-15c0-4923-abb5-941ae5520003 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:20.588644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b422dc-15c0-4923-abb5-941ae5520003 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:20.612103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 492/982] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:20 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:20.976399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18f76-680e-4dd4-ae3e-843a93c08de7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.976916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18f76-680e-4dd4-ae3e-843a93c08de7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.977025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18f76-680e-4dd4-ae3e-843a93c08de7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.978511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 491/983] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:20.983481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.983775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.984075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:21.001169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:21.002676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:21.079031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 493/984] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:21.101279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a18f76-680e-4dd4-ae3e-843a93c08de7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:21.169016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:21.203715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a18f76-680e-4dd4-ae3e-843a93c08de7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:21.238088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:21.238920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:21.239206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:21.239485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:21.240165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:21.241531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:21.253780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:21.254786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:21.255616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 492/985] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:21.261418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:21.326761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:21.363571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50147-10c5-411d-9687-aa7928e5f79d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:21.397985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:21.398671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:21.398953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:21.399229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:21.400093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:21.400411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:21.401797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:21.411728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 494/986] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:21.412830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:21.515116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de66b8-92c6-4e5f-9b84-b37ecc74872a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:21.543731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:21.549979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:21.550665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:21.550950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:21.551228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:21.551954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:21.552293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:21.553675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:21.564535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 493/987] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:21.565802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:21.678100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8fa10-fd10-4b84-b8d8-51dbe83f130b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:21.707029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:21.713852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:21.714525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:21.714808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:21.715084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:21.715900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] RBAC: Adding query filter params (interface=admin, service_id=757f9f6cef8d4888a81d16b729fdd51c, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:21.716251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:21.717652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36351-2d23-4d16-aee3-88755ce28692 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:21.728128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 495/988] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Jul 14 10:41:21 2022] GET /identity/v3/endpoints?service_id=757f9f6cef8d4888a81d16b729fdd51c&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:21.729403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:21.829712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67380a-4757-48f3-a36f-2ac9cec2f3f8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:21.867258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b929-9f25-4fd4-a1c3-dd47820301d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:21.867928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b929-9f25-4fd4-a1c3-dd47820301d9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:21.868238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b929-9f25-4fd4-a1c3-dd47820301d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:21.868684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b929-9f25-4fd4-a1c3-dd47820301d9 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:21.869478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b929-9f25-4fd4-a1c3-dd47820301d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:21.879612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b929-9f25-4fd4-a1c3-dd47820301d9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:21.892180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 494/989] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:41:21 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:41:22.334704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ecb0e-01c5-4ed4-b4c3-14836632944f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.335078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ecb0e-01c5-4ed4-b4c3-14836632944f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.335278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ecb0e-01c5-4ed4-b4c3-14836632944f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.336713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 496/990] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:22.342822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.343265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.343440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.360518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:22.361707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:22.418117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.430563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 495/991] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:22.452085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ecb0e-01c5-4ed4-b4c3-14836632944f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.556037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ecb0e-01c5-4ed4-b4c3-14836632944f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.591011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.592568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.593058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.593534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] PATH_INFO: `/v3/services/image` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.594383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.595975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-4c49895d-6fc1-425a-aed4-ae03abf1bffa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:22.608163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:22.609411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:22.610479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:22.613187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 497/992] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:22.618946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.637119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d724a-899b-4ae3-bae6-8898af51fd97 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.637407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d724a-899b-4ae3-bae6-8898af51fd97 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.637688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d724a-899b-4ae3-bae6-8898af51fd97 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.639083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 498/993] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:41:22.643979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.644312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.644607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.663882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:22.665094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:22.719861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.727084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0f4f3-934b-44ab-9cb6-d3569db14a17 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.733759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 499/994] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:22.756021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.762886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.763812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.764370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.764831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.765818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:22.766275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.767903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.773648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 496/995] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:22.779283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.841103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.867327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645f24d-c756-4811-a003-31657cc0d9c9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.892642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf466f-eb05-453a-a03f-d4933abb56ea None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.903812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.904633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.904927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.905188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.905840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.907201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:22.919568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:22.920639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:22.921607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 500/996] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:22.926422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.932394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.933067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.933352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.933633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.934362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] RBAC: Adding query filter params (type=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:22.934654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.936021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.941005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 497/997] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:22.988604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:23.042085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb0ba-a221-4beb-b9a3-920e6d665d23 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:23.078570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:23.079248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:23.079531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:23.079809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:23.080637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:23.080948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:23.082324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:23.088484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 501/998] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:23.093955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:23.196140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01e46-58a1-499f-84c8-9b3a4b1093ba None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:23.214078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:23.233006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:23.233667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:23.233949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:23.234224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:23.234921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:23.235227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:23.236628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:23.241776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 498/999] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:23.247284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:23.345703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cb47-d80b-41b4-ae34-69e6a1ae4d93 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:23.362294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:23.381282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:23.381964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:23.382230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:23.382506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:23.383295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] RBAC: Adding query filter params (interface=public, service_id=f41442f6ded14732b5b2b10ac4f4bc9c, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:23.383606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:23.385031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c8ed-8a3d-4eb9-ba7c-433bd006bc96 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:23.394418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 502/1000] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:41:23 2022] GET /identity/v3/endpoints?service_id=f41442f6ded14732b5b2b10ac4f4bc9c&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:23.396054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:23.496184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22040f0-3fe9-4afe-8f49-03e0a7fe1265 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:23.530079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68eee7-ecf1-466a-b306-6205da5ce2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:23.530744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68eee7-ecf1-466a-b306-6205da5ce2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:23.531029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68eee7-ecf1-466a-b306-6205da5ce2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:23.531303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68eee7-ecf1-466a-b306-6205da5ce2e1 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:23.531981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68eee7-ecf1-466a-b306-6205da5ce2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:23.533365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68eee7-ecf1-466a-b306-6205da5ce2e1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:23.548162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 499/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:41:23 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:41:23.902754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85626c0c-390e-477e-afbd-fd9742d14140 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:23.903260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85626c0c-390e-477e-afbd-fd9742d14140 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:23.903337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85626c0c-390e-477e-afbd-fd9742d14140 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:23.904728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 503/1002] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:23.909746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:23.910039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:23.910315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:23.927372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:23.928570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:23.971692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:23.999666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 500/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:24.020705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85626c0c-390e-477e-afbd-fd9742d14140 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:24.123592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85626c0c-390e-477e-afbd-fd9742d14140 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:24.155857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:24.156671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.156951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.157220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.157858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:24.159261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:24.171644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:24.172654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:24.178353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 504/1004] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 14 10:41:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:24.180737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:24.279321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3cb17-65b3-49d9-a0b4-fc8fa64c87c5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:24.312209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:24.312998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.313286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.313558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.314245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:24.314547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:24.315887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:24.320732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 501/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:24.326999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:24.371944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:24.425429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609b4a-724a-41e9-b030-231a020a65c9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:24.457637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:24.458290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.458571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.458846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.459576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:24.459882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:24.461254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20216c73-a8b2-44fa-8a57-1212541ab7b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:24.466838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 505/1006] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 14 10:41:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:24.472424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:24.514043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:24.571355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13472627-7637-4833-b2ec-966653757ae7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:24.606257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bbc05-5d6d-4463-a27a-3cb9246b5e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:24.606922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bbc05-5d6d-4463-a27a-3cb9246b5e3b None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.607201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bbc05-5d6d-4463-a27a-3cb9246b5e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.607472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bbc05-5d6d-4463-a27a-3cb9246b5e3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.608247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bbc05-5d6d-4463-a27a-3cb9246b5e3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:24.609589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bbc05-5d6d-4463-a27a-3cb9246b5e3b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:24.626139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 502/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:24.987782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6b43e-4c1f-4609-9155-865469f90cae None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.988335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6b43e-4c1f-4609-9155-865469f90cae None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.988411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6b43e-4c1f-4609-9155-865469f90cae None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.989952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 506/1008] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:24.994964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752e14-d291-48a0-885d-06abbfa1fd6b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.995261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752e14-d291-48a0-885d-06abbfa1fd6b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.995543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752e14-d291-48a0-885d-06abbfa1fd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.012821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-41752e14-d291-48a0-885d-06abbfa1fd6b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:25.014013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-41752e14-d291-48a0-885d-06abbfa1fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:25.086621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 503/1009] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:25.109519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6b43e-4c1f-4609-9155-865469f90cae None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.212051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6b43e-4c1f-4609-9155-865469f90cae None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.221954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.247893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c900af2-7b2d-4c80-94c8-97e5d59004d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.248590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c900af2-7b2d-4c80-94c8-97e5d59004d8 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.248875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c900af2-7b2d-4c80-94c8-97e5d59004d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.249152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c900af2-7b2d-4c80-94c8-97e5d59004d8 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.249890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c900af2-7b2d-4c80-94c8-97e5d59004d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:25.251246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c900af2-7b2d-4c80-94c8-97e5d59004d8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:25.272961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 507/1010] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:25 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:25.594802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2a23d-d1bc-44f3-bbc1-a0dfad4a3d28 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.595300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2a23d-d1bc-44f3-bbc1-a0dfad4a3d28 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.595300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2a23d-d1bc-44f3-bbc1-a0dfad4a3d28 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.596804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 504/1011] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:25.601906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.602202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.602477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.622786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:25.624025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:25.702389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 508/1012] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:25 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:25.724298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2a23d-d1bc-44f3-bbc1-a0dfad4a3d28 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.752672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.831055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2a23d-d1bc-44f3-bbc1-a0dfad4a3d28 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.869820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.870621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.870900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.871173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.871824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:25.873214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:25.884983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:25.885953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:25.886778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 505/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:25.891959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.982967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.991717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646074a-b964-4799-ae92-dabe16edb09c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:26.025488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:26.026144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.026423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.026693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.027391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:26.027695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:26.029069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:26.034167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 509/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:26.039537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:26.128992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:26.139693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad62d2-61c0-4117-b879-765b224b2a0f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:26.173427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:26.174082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.174359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.174630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.175324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:26.175626 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:26.176991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb549-ee39-4df5-8de9-a2ab0aaddd4c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:26.182139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 506/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 14 10:41:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:26.187511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:26.285934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e087-79da-4078-8bde-235c2d9e2073 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:26.319711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24130838-a378-43ed-a1a1-105b1725bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:26.320388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24130838-a378-43ed-a1a1-105b1725bdd1 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.320670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24130838-a378-43ed-a1a1-105b1725bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.320944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24130838-a378-43ed-a1a1-105b1725bdd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.322204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24130838-a378-43ed-a1a1-105b1725bdd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:26.323813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24130838-a378-43ed-a1a1-105b1725bdd1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:26.348099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 510/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:26.718894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7740d-9e90-49f8-941c-6f16e674a2ee None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.719443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7740d-9e90-49f8-941c-6f16e674a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.719443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7740d-9e90-49f8-941c-6f16e674a2ee None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.720985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 507/1017] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:26.726063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.726359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.726640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.743143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:26.744891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:26.754708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:26.824138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 511/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:26.844684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7740d-9e90-49f8-941c-6f16e674a2ee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:26.951003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7740d-9e90-49f8-941c-6f16e674a2ee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:26.985206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ded7a-ba83-49b9-a82c-7e277fc01ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:26.985669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ded7a-ba83-49b9-a82c-7e277fc01ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.985954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ded7a-ba83-49b9-a82c-7e277fc01ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.986229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ded7a-ba83-49b9-a82c-7e277fc01ef7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.987433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ded7a-ba83-49b9-a82c-7e277fc01ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:26.988890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ded7a-ba83-49b9-a82c-7e277fc01ef7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:26.995906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 508/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:26.997167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:27.094870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e578a96-e0df-455d-8000-7e076f2f3b21 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:27.128935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2de22-235f-4da2-b2ee-824f8d045e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:27.129602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2de22-235f-4da2-b2ee-824f8d045e98 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:27.129887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2de22-235f-4da2-b2ee-824f8d045e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:27.130168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2de22-235f-4da2-b2ee-824f8d045e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:27.130877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2de22-235f-4da2-b2ee-824f8d045e98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:27.132353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2de22-235f-4da2-b2ee-824f8d045e98 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:27.142914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:27.165263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 512/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:26 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:27.348432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b4f2-1d51-4f00-b9c2-954307e048ed None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:27.348646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b4f2-1d51-4f00-b9c2-954307e048ed None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:27.348928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b4f2-1d51-4f00-b9c2-954307e048ed None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:27.350447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 509/1021] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:27.355699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:27.355981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:27.356332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:27.373132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:27.374539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:27.441881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 513/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:27.464740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97b4f2-1d51-4f00-b9c2-954307e048ed None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:27.489158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:27.569848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97b4f2-1d51-4f00-b9c2-954307e048ed None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:27.603636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:27.604382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:27.604671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:27.604950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] PATH_INFO: `/v3/services/image` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:27.605603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:27.606959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:27.619292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:27.620326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:27.621173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:27.625512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 510/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 14 10:41:27 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:27.626502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:27.726353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fb514-5437-4c2c-ba8e-067dda4df545 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:27.749774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:27.763977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:27.764676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:27.764963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:27.765331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:27.765977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] RBAC: Adding query filter params (name=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:27.766290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:27.767655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:27.777677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 514/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:27.778799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:27.867602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:27.886957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c81c9a-848d-4ba6-994b-5d4da88975ce None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:27.921163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:27.921834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:27.922117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:27.922392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:27.923095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] RBAC: Adding query filter params (type=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:27.923402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:27.924794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:27.934370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 511/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:27.935466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.034225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef7e0f-8bed-493e-b9e5-16914cf4ab3b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.069265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.069929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.070215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.070495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.071388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] RBAC: Adding query filter params (interface=public, service_id=f86b63566dee4bd0bf7589a5b296b899, region_id=RegionOne) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:28.071631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:28.073273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9821426-b922-4504-99b2-66510fbdbe32 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:28.086305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 515/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:41:27 2022] GET /identity/v3/endpoints?service_id=f86b63566dee4bd0bf7589a5b296b899&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:28.087332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.188106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742b951-4afb-4817-875a-4b5e7f4deeaa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.222324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87871741-1b35-40df-9552-7b129d2279ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.223034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871741-1b35-40df-9552-7b129d2279ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.223361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871741-1b35-40df-9552-7b129d2279ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.223662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871741-1b35-40df-9552-7b129d2279ff None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.224367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871741-1b35-40df-9552-7b129d2279ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:28.225736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871741-1b35-40df-9552-7b129d2279ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:28.240504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 512/1027] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:41:28.481056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c4767-e2af-472b-a72e-ec28084d4dd4 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.481240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c4767-e2af-472b-a72e-ec28084d4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.481524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c4767-e2af-472b-a72e-ec28084d4dd4 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.482887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 516/1028] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:28.487841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.488160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.488438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.505622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:28.506792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:28.516034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:28.580137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 513/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:28.597909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c4767-e2af-472b-a72e-ec28084d4dd4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.650303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:28.703822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c4767-e2af-472b-a72e-ec28084d4dd4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.738506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.739236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.739514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.739782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.750105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:28.758372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:28.759878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:28.760762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 517/1030] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:28.765896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.874120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a63d5e-2235-4110-9fdf-95ef4f49a5fc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.910312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.910979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.911257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.911530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.912289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:28.912594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:28.913934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:28.926818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 514/1031] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:28.927983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.028791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c89b-4663-4aed-b4c8-d912b7dfff33 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.038629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:29.065739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.066738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.067197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.067659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.079539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.081159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-1f7d7fea-c594-4b50-aa31-8d7d1fb7962a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:29.098358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:29.099452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:29.100493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:29.100493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:29.100493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:29.100493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:29.105990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 518/1032] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:29.107265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.117137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:29.211457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fffff-b94e-444a-aa30-ba81dbc8b317 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.244803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63436ce-b718-4d4c-8320-bb0e44b35908 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.245119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63436ce-b718-4d4c-8320-bb0e44b35908 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.245366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63436ce-b718-4d4c-8320-bb0e44b35908 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.246740 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 519/1033] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:29.246946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.247636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.247895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.248295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.248933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:29.249243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.250600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.251522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.251806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.252306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.263428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 515/1034] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:29.269141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.274234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:29.275472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:29.342877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:29.348116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 520/1035] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:29.370728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.383389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe50623-e8df-46bf-aaa8-bf8d3334cec4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.425781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.426902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.427455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.427744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.436878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.438314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:29.453493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:29.454414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:29.455375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 516/1036] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:41:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:29.460728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.463747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:29.473906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68126fc-198e-41ab-a199-d5bd01caa797 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.509337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.510127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.510412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.510698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.511868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.513326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.514943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 521/1037] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:29.520456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.567961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1d74-12b6-41cf-a5cc-d3c800f50cd3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.593864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:29.603541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.604239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.604534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.604807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.605639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:29.605951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.607372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.629765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 517/1038] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:41:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:29.631023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.634534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439423-80eb-4d90-a51b-c5ccbc7b205f None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.674424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.675390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.675850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.676356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.677201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.678753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.701852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 522/1039] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:41:29 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:41:29.748859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d433f50-4514-4da5-9533-94a5bc6c85da None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:29.787082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:29.787744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:29.788025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:29.788329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:29.845195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:29.870070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:29.871310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:29.972368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 518/1040] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:29.978279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:29.997131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.081474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e90b-cf0d-484f-902e-355ddde8d71c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.114885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.115586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.115869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.116173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.127539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.129004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-e404e0fe-5a1e-4549-a3cf-5e89e880207e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:30.145996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:30.146875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:30.147762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:30.147762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:30.147762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:30.147762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:30.147762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 523/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:30.153703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.242816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.260700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9c91a-7341-484e-8d7a-aeef610cb933 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.275825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8b8f6-19f7-4ddb-b0bc-e56b88ddc724 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.276155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8b8f6-19f7-4ddb-b0bc-e56b88ddc724 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.276437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8b8f6-19f7-4ddb-b0bc-e56b88ddc724 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.277940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 524/1042] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:30.282513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.282799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.283078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.298078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.298743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.299124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.299405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.299691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:30.300151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:30.300465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.300907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:30.301827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.315347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 519/1043] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:30.320740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.367330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.376639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 525/1044] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:30.399476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.453853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c304457-3d8c-4008-a5af-970a341ef584 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.490541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.491449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.492106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.492219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.500290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.501963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.510800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4c989-e7f0-4242-8a37-b203f01f1bcf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:30.517724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:30.518594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:30.519515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 520/1045] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:30.524600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.528253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.549729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.550523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.550806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.551083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] PATH_INFO: `/v3/services/image` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.551737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.553139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:30.565328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:30.566307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:30.567142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 526/1046] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:30.572531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.637103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.637363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42259eeb-c70e-4aaf-8316-7c7aaa579a67 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.673647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.674407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.674895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.675103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.675858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:30.676198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.677551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ba26d-1899-4b2e-b0e3-45fb8aae4e79 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.677670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.692336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 521/1047] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:30.698306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.715853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.716545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.716837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.717110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.717818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] RBAC: Adding query filter params (name=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:30.718133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.719512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.724742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 527/1048] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:30.730817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.763489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.805144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fee82-b066-43ed-9455-822b96e98ba2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.840522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05365537-a6bd-4f96-b079-90be602cec2b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:30.840736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.841399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.841685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.841969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.842797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] RBAC: Adding query filter params (role.id=897b421494104cfc8c32e1c9b8a8733e, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=11d05026ac51451a8c10fb63f840d15f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:30.843118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.844574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.860092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 522/1049] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/role_assignments?user.id=11d05026ac51451a8c10fb63f840d15f&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=897b421494104cfc8c32e1c9b8a8733e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:30.885547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:30.896672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:30.897366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.897726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.898077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.898873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] RBAC: Adding query filter params (type=image) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:30.899278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:30.901321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b36fe-f1bf-444d-86a7-0aeb091a168f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:30.907803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 528/1050] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:30.913439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:31.023327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f9e93-c550-4eda-ba54-bb588fc53454 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:31.049917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:31.058964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272c39-3012-465f-89f3-0016949d9b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:31.059627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272c39-3012-465f-89f3-0016949d9b51 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:31.059913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272c39-3012-465f-89f3-0016949d9b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:31.060223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272c39-3012-465f-89f3-0016949d9b51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:31.060984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272c39-3012-465f-89f3-0016949d9b51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:31.062341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272c39-3012-465f-89f3-0016949d9b51 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:31.081767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 523/1051] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:41:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:31.794072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb325-d01c-4113-ab45-78d1faf26fee None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:31.794621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb325-d01c-4113-ab45-78d1faf26fee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:31.794621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb325-d01c-4113-ab45-78d1faf26fee None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:31.796004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 529/1052] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:31.801120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:31.801408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:31.801682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:31.818742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:31.819917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:31.898643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 524/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:31.922282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb325-d01c-4113-ab45-78d1faf26fee None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:32.027561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb325-d01c-4113-ab45-78d1faf26fee None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:32.061052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:32.061767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.062049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.062322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.072397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:32.080228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:32.081158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:32.082048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:32.083462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 530/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:32.087852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:32.188506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95611103-8ab2-4954-8367-b5ace7434730 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:32.200498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:32.227438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:32.228691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.228977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.229253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.229994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:32.230299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:32.231660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:32.244606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 525/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:32.246105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:32.297481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:32.348865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2ff4-200f-4b80-802d-75dd28ba78b3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:32.380667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:32.381530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.381807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.382077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] PATH_INFO: `/v3/users/25c6b0b45f1a4c658f335d751a60df27` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.395589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] RBAC: Authorizing `identity:get_user(user_id=25c6b0b45f1a4c658f335d751a60df27)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:32.397034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:32.398826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 531/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:32 2022] GET /identity/v3/users/25c6b0b45f1a4c658f335d751a60df27 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:32.405012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:32.502880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393fea7-eae5-4b1a-b79f-5ac2314efa0a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:32.536213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:32.536857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.537135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.537405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.579027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:32.606835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:32.608243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:32.712987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 526/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:32.714466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:32.812145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e615-b4c8-438e-a388-44bb10854429 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:32.822183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:32.847719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c521d6-c6bd-427b-b95e-759619e66a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:32.848602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c521d6-c6bd-427b-b95e-759619e66a18 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.848880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c521d6-c6bd-427b-b95e-759619e66a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.849152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c521d6-c6bd-427b-b95e-759619e66a18 None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.850309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c521d6-c6bd-427b-b95e-759619e66a18 None admin] RBAC: Authorizing `identity:get_project(project_id=88fc579e8d8f497ca9080c07ee56513e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:32.851737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c521d6-c6bd-427b-b95e-759619e66a18 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:32.853650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 532/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:32 2022] GET /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:32.859571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:32.893347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54622e-3bc8-439e-ac30-ca4d10d6b608 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.893913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54622e-3bc8-439e-ac30-ca4d10d6b608 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.894200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54622e-3bc8-439e-ac30-ca4d10d6b608 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.895706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 533/1059] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:32.900850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:32.901134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:32.901410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:32.919517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:32.921968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:32.941082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:32.973736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff918a1-a751-43ef-8b13-40ba5e41894e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:32.996099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 534/1060] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:33.009780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.010521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.010871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.011221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.012144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=88fc579e8d8f497ca9080c07ee56513e, user.id=25c6b0b45f1a4c658f335d751a60df27) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:33.012523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.014036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa08b4-33a0-40e7-82a7-0a8d5efaf0ad None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.019117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.020194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 527/1061] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:32 2022] GET /identity/v3/role_assignments?user.id=25c6b0b45f1a4c658f335d751a60df27&scope.project.id=88fc579e8d8f497ca9080c07ee56513e&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:33.126751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c5728-be25-41cd-91c1-3f9abd85eaeb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.135630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.135945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4faca4-c970-425d-889e-241a091c7702 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.136437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4faca4-c970-425d-889e-241a091c7702 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4faca4-c970-425d-889e-241a091c7702 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.138093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 528/1062] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:41:33.143777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.144212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.144564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.164272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:33.166056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:33.171123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.171949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.172269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.172551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.183693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:33.192552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:33.193730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:33.194709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 535/1063] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:33.200115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.244504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 529/1064] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:33.261821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.311158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697d2a-d9a4-4389-a764-2055c6952dd1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.332297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.344894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.345555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.345840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.346115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.346861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:33.347166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.348558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.362399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 536/1065] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:33.363662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.377347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd462-4d74-40e4-ab5f-f6b01eb18d4f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.392956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.414771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.416040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.416363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.416640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.468631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812cae5-0627-4312-9131-f31b790857b8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.495061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.496549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.504971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.505764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.506055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.506711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.518433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.520156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:33.539003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:33.539955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:33.541419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:33.541419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:33.541419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:33.541419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:33.541419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 537/1066] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:33.546422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.562774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.603712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 530/1067] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:33.609497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.632547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.653600 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69286a1-7a16-422e-ab2b-7c28fb0900b2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.688278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.688936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.689216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.689486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.690203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:33.690506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.691870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.704603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 538/1068] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:33.710071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.724786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921b59-6f2c-4fc6-9da5-6505736c9409 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.761408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.762206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.762493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.762776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.773726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.775691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:33.795249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:33.796174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:33.797274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:33.797274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:33.797274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:33.797274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:33.797274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 531/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:33.802188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.815681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185ac13-7254-42b2-a39b-296904e7eeb6 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.822658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.852660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.853440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.853720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.854003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.864643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.866753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.878290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:33.887499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:33.888477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:33.890329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 539/1070] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:33.894978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.911676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863da79-13a8-4fd5-8876-20cc7f61ec61 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.949697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.950483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.950766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.951041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.951759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:33.952092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.953599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.967886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 532/1071] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:34.011028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fab0c8-de69-4fed-8584-0535f7b84fff None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:34.048929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:34.049621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:34.049905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:34.050184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:34.051048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:34.051370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:34.052866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:34.078231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 540/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:34.080164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:34.169659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:34.196830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0aa4a-2586-4e76-b1ad-bb6043a19945 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:34.231816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:34.232650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:34.232936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:34.233214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:34.244377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:34.246006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:34.263801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:34.264784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:34.265800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:34.265800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:34.265800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:34.265800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:34.265800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 533/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:34.270716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:34.328706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:34.372594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50712aa-6297-4c54-a686-e008985e50de None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:34.404729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:34.405372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:34.405652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:34.405922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:34.406637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:34.406939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:34.408302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:34.418917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 541/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:34.424638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:34.520655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db636-ca1e-4043-889f-49d888abfbe9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:34.547630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:34.553956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:34.554743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:34.555024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:34.555297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:34.562380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:34.563811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:34.578049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:34.578923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:34.579786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 534/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:34.585010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:34.683891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83123dd0-a27a-4130-9202-9d8e473d3183 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:34.700242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:34.716780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:34.717436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:34.717716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:34.717989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:34.718772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:34.719079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:34.720532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93b4b-ed53-416a-9905-cb93d983656f None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:34.732891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 542/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:34.738666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:34.836202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832c45-7e76-477e-98c5-ed1afe6c7c2b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:34.869997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6cbc-563b-4a1e-8392-b102219cc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:34.870891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6cbc-563b-4a1e-8392-b102219cc7ac None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:34.871175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6cbc-563b-4a1e-8392-b102219cc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:34.871455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6cbc-563b-4a1e-8392-b102219cc7ac None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/11d05026ac51451a8c10fb63f840d15f/roles/897b421494104cfc8c32e1c9b8a8733e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:34.873706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6cbc-563b-4a1e-8392-b102219cc7ac None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=11d05026ac51451a8c10fb63f840d15f, role_id=897b421494104cfc8c32e1c9b8a8733e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:34.875144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6cbc-563b-4a1e-8392-b102219cc7ac None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:34.888719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 535/1077] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:34 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/11d05026ac51451a8c10fb63f840d15f/roles/897b421494104cfc8c32e1c9b8a8733e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:35.067717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8f88-c807-456d-af6d-57a21633c9e0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.068273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8f88-c807-456d-af6d-57a21633c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.068273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8f88-c807-456d-af6d-57a21633c9e0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.069602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 543/1078] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:35.075817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.076129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.076411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.092777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:35.093943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:35.139828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:35.160861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 536/1079] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:35.183244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8f88-c807-456d-af6d-57a21633c9e0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.280304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8f88-c807-456d-af6d-57a21633c9e0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.312915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.313696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.313977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.314258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.324621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:35.332083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:35.333373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:35.334519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 544/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:35.339565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.437629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3e68-a849-46c4-bdb4-2d2a21339d7a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.470193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.470859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.471143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.471419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.472194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:35.472502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:35.473848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:35.482379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 537/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:35.488164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.528836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:35.586702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5016c-d0d9-448e-809f-59588622bb08 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.620677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.621545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.621829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.622107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] PATH_INFO: `/v3/users/25c6b0b45f1a4c658f335d751a60df27` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.623299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] RBAC: Authorizing `identity:get_user(user_id=25c6b0b45f1a4c658f335d751a60df27)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:35.624794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:35.626423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 545/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:35 2022] GET /identity/v3/users/25c6b0b45f1a4c658f335d751a60df27 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:35.632117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.674969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:35.730678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03c533-3125-4bdd-b616-a9f273cbbe34 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.763078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde84ca-8269-48f0-9306-c05b67f4d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.763948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde84ca-8269-48f0-9306-c05b67f4d015 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.764254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde84ca-8269-48f0-9306-c05b67f4d015 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.764527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde84ca-8269-48f0-9306-c05b67f4d015 None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.765680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde84ca-8269-48f0-9306-c05b67f4d015 None admin] RBAC: Authorizing `identity:get_project(project_id=88fc579e8d8f497ca9080c07ee56513e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:35.767080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde84ca-8269-48f0-9306-c05b67f4d015 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:35.768765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 538/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:35 2022] GET /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:35.774563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.869144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed6da-c01c-40de-be38-17d1f4eb616a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.879138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:35.905265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9853f9-891e-4871-bec8-7e080e6b75a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.906134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9853f9-891e-4871-bec8-7e080e6b75a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.906413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9853f9-891e-4871-bec8-7e080e6b75a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.906684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9853f9-891e-4871-bec8-7e080e6b75a2 None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e/users/25c6b0b45f1a4c658f335d751a60df27/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.908631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9853f9-891e-4871-bec8-7e080e6b75a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=88fc579e8d8f497ca9080c07ee56513e, user_id=25c6b0b45f1a4c658f335d751a60df27, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:35.910044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9853f9-891e-4871-bec8-7e080e6b75a2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:35.922453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 546/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:35 2022] PUT /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e/users/25c6b0b45f1a4c658f335d751a60df27/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:36.876994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeabb13-da04-4c2b-80ae-a88ea82cbd15 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:36.877457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeabb13-da04-4c2b-80ae-a88ea82cbd15 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:36.877547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeabb13-da04-4c2b-80ae-a88ea82cbd15 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:36.878925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 539/1085] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:36.884697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:36.885126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:36.885236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:36.902018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:36.903204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:36.968566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 547/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:36.991423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeabb13-da04-4c2b-80ae-a88ea82cbd15 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:37.105178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeabb13-da04-4c2b-80ae-a88ea82cbd15 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:37.115503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:37.138781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:37.139591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.139877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.140183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.150656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:37.158858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:37.159939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:37.161003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 540/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 14 10:41:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:37.166214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:37.255822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:37.263059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794d88-774a-4b5d-bd3c-bc43076a8fd5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:37.294963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:37.295619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.295896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.296201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.296939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:37.297241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:37.298580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:37.306754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 548/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:37.312371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:37.416602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57268-e796-4144-9b01-7bd407d4c47c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:37.450084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:37.450868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.451153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.451434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.461901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:37.463340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:37.480071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:37.480955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:37.482028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:37.482028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:37.482028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:37.482028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:37.482028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 541/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:37.486983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:37.584723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c6238-747a-4264-a7c7-52b20c8c5f5c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:37.617742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:37.619006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.619318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.619594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.620364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:37.620673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:37.622033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:37.634041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 549/1090] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:37.639598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:37.663688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:37.739308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca2aa-49d1-461a-a658-f999cb484f58 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:37.771826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:37.772640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.772924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.773202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.780570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:37.781998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-4445fc4e-b113-40b8-8d20-6060b46b77a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:41:37.796362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:37.797413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:37.798342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 542/1091] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 14 10:41:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:37.803274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:37.822306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:37.902418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f6a67-32e5-4f42-9f9f-61f1213a7ed9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:37.930393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68f39a-9fac-4895-a255-e8b855afdb61 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.930940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68f39a-9fac-4895-a255-e8b855afdb61 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.931054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68f39a-9fac-4895-a255-e8b855afdb61 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.932398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 543/1092] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:41:37.936101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:37.936778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.937059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.937228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:37.937326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.937516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:37.937798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:37.938157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:37.938467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:37.939926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:37.954873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:37.956101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:37.958476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 550/1093] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 14 10:41:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:37.964761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.022502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 544/1094] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:41:38.039072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.045472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.059995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.063420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a590d29-9b2f-4356-bad8-2f96aed9cb45 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.098154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.098802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.099089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.099373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.145305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aaeb3-7f0c-44bf-9ba0-c2a9793f4248 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.164806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.166259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.177867 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.178655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.178942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.179222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.190083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:38.198549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:38.199700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:41:38.200596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 545/1095] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:38.205934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.239485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.263365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 551/1096] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:38.269150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.276947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.307965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc513fa-285e-46c1-a658-b2e0f9e7ecb3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.341165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.341825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.342104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.342379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.343129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:38.343442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.344815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.353344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 546/1097] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:38.359043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.364917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6bc0-5238-4267-bea8-3bd0d2ccd283 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.398712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.399517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.399804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.400101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.409769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.411191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:38.428923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:38.430007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:38.431687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:38.431687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:38.431687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:38.431687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:38.431687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 552/1098] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:38.436371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.459275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdf7bd-5b30-4025-b1de-9164d0949c51 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.463249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.492124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.493582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.493882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.494162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] PATH_INFO: `/v3/users/25c6b0b45f1a4c658f335d751a60df27` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.495361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] RBAC: Authorizing `identity:get_user(user_id=25c6b0b45f1a4c658f335d751a60df27)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.496846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.498619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 547/1099] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/users/25c6b0b45f1a4c658f335d751a60df27 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:38.504020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.506586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.532827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22d684-8bc0-46be-ada2-5081abf0a8f1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.566250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.566904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.567186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.567460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.568207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:38.568513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.569875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.585686 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 553/1100] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:38.586667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.601842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5b81a-eeae-4bd4-b96a-ca6a2071d337 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.636375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.637023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.637308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.637591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.674336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.686391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc60f-bbfb-4780-8ec1-c1df0273b2ad None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.705881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.707351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.709285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.719287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.720083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.720380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.720658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.727328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.728787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:38.742615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:38.744182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:38.745083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:38.748211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 554/1101] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:38.750442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.809232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 548/1102] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:38.813924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.851494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccade3-1e68-44d2-8576-82d836161399 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.887814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.888526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.888815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.889097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.889887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:38.890205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.891630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.903854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 555/1103] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:38.909568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.915475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e6c09-700f-4389-8dd9-0e898748f2f9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.917042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.920466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.951146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.952000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.952315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.952597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.953775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] RBAC: Authorizing `identity:get_project(project_id=88fc579e8d8f497ca9080c07ee56513e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.955201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.956932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 549/1104] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:38.963403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:39.016706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d682d-1a4b-475a-a477-2be1b3158a3d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:39.050042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:39.050690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:39.050976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:39.051252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:39.052105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] RBAC: Adding query filter params (role.id=897b421494104cfc8c32e1c9b8a8733e, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=11d05026ac51451a8c10fb63f840d15f) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:39.052430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:39.053854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fa723-feb6-45a3-8e20-06a18ea40fca None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:39.059592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 556/1105] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/role_assignments?user.id=11d05026ac51451a8c10fb63f840d15f&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=897b421494104cfc8c32e1c9b8a8733e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:39.067409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8dc80-31d8-4d22-9b4f-c064e86e8329 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:39.105218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:39.105884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:39.106166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:39.106444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:39.107296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=88fc579e8d8f497ca9080c07ee56513e, user.id=25c6b0b45f1a4c658f335d751a60df27) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:39.107612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:39.109189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfda453-37ee-45a7-9e45-01105e32401d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:39.115979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 550/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/role_assignments?user.id=25c6b0b45f1a4c658f335d751a60df27&scope.project.id=88fc579e8d8f497ca9080c07ee56513e&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:41.185421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d939f-14f5-48e8-b269-927e85c76a91 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.185923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d939f-14f5-48e8-b269-927e85c76a91 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.186015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d939f-14f5-48e8-b269-927e85c76a91 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.187326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 557/1107] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:41.192427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.192824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.192992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.210110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:41.211289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:41.236730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:41.276567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 551/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:41.300699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d939f-14f5-48e8-b269-927e85c76a91 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:41.369637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:41.397990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d939f-14f5-48e8-b269-927e85c76a91 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:41.429715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2723-dc8d-44dc-957a-0ec3c8982030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:41.431066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2723-dc8d-44dc-957a-0ec3c8982030 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.431346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2723-dc8d-44dc-957a-0ec3c8982030 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.431617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2723-dc8d-44dc-957a-0ec3c8982030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.432783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2723-dc8d-44dc-957a-0ec3c8982030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:41.434184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2723-dc8d-44dc-957a-0ec3c8982030 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:41.435791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 558/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:41.441233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:41.536070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d050-e286-4b07-9827-e104d95bcf7d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:41.569114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca403d5-5910-45ba-a437-941becd0a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:41.569764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca403d5-5910-45ba-a437-941becd0a14b None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.570046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca403d5-5910-45ba-a437-941becd0a14b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.570323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca403d5-5910-45ba-a437-941becd0a14b None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.571030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca403d5-5910-45ba-a437-941becd0a14b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:41.572469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca403d5-5910-45ba-a437-941becd0a14b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:41.592077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 552/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:41:41 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:43.630426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11e22-b286-4ba0-855b-e729be13b8d7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:43.631010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11e22-b286-4ba0-855b-e729be13b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:43.631445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11e22-b286-4ba0-855b-e729be13b8d7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:43.632986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 559/1111] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:43.639013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:43.639434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:43.639578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:43.655925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:43.657149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:43.671199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:43.723554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 553/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:43.747328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11e22-b286-4ba0-855b-e729be13b8d7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:43.844304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11e22-b286-4ba0-855b-e729be13b8d7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:43.877559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:43.878411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:43.878692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:43.878965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] PATH_INFO: `/v3/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:43.880520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] RBAC: Authorizing `identity:get_role(role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:43.881832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:43.883204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 560/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:43 2022] GET /identity/v3/roles/7607d90167e342db84bf7531c1ee5b29 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:43.888882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:43.985707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafce19a-30be-4086-a5c8-39f9ad90ebda None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.017917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.018769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.019054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.019337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] PATH_INFO: `/v3/users/eb5296b993844dd397ac68cd6babdd65` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.032506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5296b993844dd397ac68cd6babdd65)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.033925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.035539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 554/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:43 2022] GET /identity/v3/users/eb5296b993844dd397ac68cd6babdd65 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:44.041658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.052005 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.136641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d983-3fc2-4c54-8279-241c0be64ea3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.170307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.170935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.171216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.171492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.234701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.236154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.245644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.329843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 561/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:44.335767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.346231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.432551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb0a57-10e4-4bbf-a352-af6a193b5536 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.466727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45086c1-ea25-4b09-96f9-89b6ed8e3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.467567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086c1-ea25-4b09-96f9-89b6ed8e3235 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.467851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086c1-ea25-4b09-96f9-89b6ed8e3235 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.468154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086c1-ea25-4b09-96f9-89b6ed8e3235 None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.469323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45086c1-ea25-4b09-96f9-89b6ed8e3235 None admin] RBAC: Authorizing `identity:get_project(project_id=88fc579e8d8f497ca9080c07ee56513e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.470739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45086c1-ea25-4b09-96f9-89b6ed8e3235 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.472445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 555/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:44.478372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.570570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84310bfe-0fb6-4f77-a28f-4b73321d4212 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.579997 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.604601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.605245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.605525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.605800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.606613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] RBAC: Adding query filter params (role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=88fc579e8d8f497ca9080c07ee56513e, user.id=eb5296b993844dd397ac68cd6babdd65) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:44.606924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.608359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c337d5-aa8c-42af-adbc-e715166c643b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.613671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 562/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/role_assignments?user.id=eb5296b993844dd397ac68cd6babdd65&scope.project.id=88fc579e8d8f497ca9080c07ee56513e&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:46.603166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe5f5-106e-49c3-a601-5b4d4bc1c9c8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:46.603762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe5f5-106e-49c3-a601-5b4d4bc1c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:46.603762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe5f5-106e-49c3-a601-5b4d4bc1c9c8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:46.605240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 556/1118] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:46.610325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:46.610712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:46.610890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:46.627856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:46.629068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:46.692210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 563/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:46.714450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe5f5-106e-49c3-a601-5b4d4bc1c9c8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:46.789095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:46.812566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe5f5-106e-49c3-a601-5b4d4bc1c9c8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:46.850362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:46.851204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:46.851484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:46.851758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] PATH_INFO: `/v3/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:46.853859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] RBAC: Authorizing `identity:get_role(role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:46.855162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:46.856571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 557/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:46 2022] GET /identity/v3/roles/7607d90167e342db84bf7531c1ee5b29 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:46.862369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:46.958088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a31ea-a86f-4761-b337-d6a7e71a61d8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:46.959557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:46.991833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:46.992750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:46.993041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:46.993320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] PATH_INFO: `/v3/users/eb5296b993844dd397ac68cd6babdd65` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:46.994495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] RBAC: Authorizing `identity:get_user(user_id=eb5296b993844dd397ac68cd6babdd65)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:46.995915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:46.997566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 564/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:46 2022] GET /identity/v3/users/eb5296b993844dd397ac68cd6babdd65 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:47.003302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:47.098235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c80241-bdd6-483a-ac51-02b1d59ef0e1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:47.130644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9dd32-4f61-4328-8ba6-c3c30bbb0e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:47.131441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9dd32-4f61-4328-8ba6-c3c30bbb0e0f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:47.131724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9dd32-4f61-4328-8ba6-c3c30bbb0e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:47.132002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9dd32-4f61-4328-8ba6-c3c30bbb0e0f None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:47.133203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9dd32-4f61-4328-8ba6-c3c30bbb0e0f None admin] RBAC: Authorizing `identity:get_project(project_id=88fc579e8d8f497ca9080c07ee56513e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:47.134621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9dd32-4f61-4328-8ba6-c3c30bbb0e0f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:47.136334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 558/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:47 2022] GET /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:47.142160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:47.239071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e171-49ec-4bcd-b10d-ba64aa0c9d9d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:47.271417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f8596-90ac-4951-9088-0fec20424ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:47.272312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f8596-90ac-4951-9088-0fec20424ced None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:47.272595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f8596-90ac-4951-9088-0fec20424ced None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:47.272867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f8596-90ac-4951-9088-0fec20424ced None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e/users/eb5296b993844dd397ac68cd6babdd65/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:47.275549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f8596-90ac-4951-9088-0fec20424ced None admin] RBAC: Authorizing `identity:create_grant(project_id=88fc579e8d8f497ca9080c07ee56513e, user_id=eb5296b993844dd397ac68cd6babdd65, role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:47.276995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f8596-90ac-4951-9088-0fec20424ced None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:47.289123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 565/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:47 2022] PUT /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e/users/eb5296b993844dd397ac68cd6babdd65/roles/7607d90167e342db84bf7531c1ee5b29 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:49.255791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669737-c5a9-4fd1-9481-cb67dc594b37 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:49.256373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669737-c5a9-4fd1-9481-cb67dc594b37 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:49.256373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669737-c5a9-4fd1-9481-cb67dc594b37 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:49.257820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 559/1124] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:49.263349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:49.263774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:49.263885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:49.281364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:49.282535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:49.305615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:49.347175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 566/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:49.370963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21669737-c5a9-4fd1-9481-cb67dc594b37 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:49.385333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:49.471197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21669737-c5a9-4fd1-9481-cb67dc594b37 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:49.507748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:49.508567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:49.508849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:49.509124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] PATH_INFO: `/v3/roles/7607d90167e342db84bf7531c1ee5b29` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:49.510574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] RBAC: Authorizing `identity:get_role(role_id=7607d90167e342db84bf7531c1ee5b29)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:49.511927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:49.513308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 560/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:49 2022] GET /identity/v3/roles/7607d90167e342db84bf7531c1ee5b29 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:49.519158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:49.618604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176b45e-3d10-4031-aca6-4149dac4fe52 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:49.653808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:49.654746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:49.655055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:49.655353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] PATH_INFO: `/v3/users/eb5296b993844dd397ac68cd6babdd65` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:49.656560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5296b993844dd397ac68cd6babdd65)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:49.657990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:49.659590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 567/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:49 2022] GET /identity/v3/users/eb5296b993844dd397ac68cd6babdd65 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:49.665114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:49.751828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:49.778224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90545901-2b5a-4da5-9afe-48a13ca4ee3c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:49.810676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:49.811315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:49.811596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:49.811871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:49.878381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:49.879817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:49.955678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:49.975104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 561/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:49.981093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:50.008325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:50.076972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ff4a-a9ca-42ec-bbda-968ffa1ba375 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:50.108446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339cd89-6e82-43b6-a040-cc6ee78755bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:50.109329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339cd89-6e82-43b6-a040-cc6ee78755bf None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:50.109612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339cd89-6e82-43b6-a040-cc6ee78755bf None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:50.109887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339cd89-6e82-43b6-a040-cc6ee78755bf None admin] PATH_INFO: `/v3/projects/88fc579e8d8f497ca9080c07ee56513e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:50.111042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339cd89-6e82-43b6-a040-cc6ee78755bf None admin] RBAC: Authorizing `identity:get_project(project_id=88fc579e8d8f497ca9080c07ee56513e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:50.112491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339cd89-6e82-43b6-a040-cc6ee78755bf None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:50.114145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 568/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:49 2022] GET /identity/v3/projects/88fc579e8d8f497ca9080c07ee56513e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:50.120513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:50.215178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fcc5f-1968-4bb6-a61d-bda66a2ad14e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:50.247604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:50.248261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:50.248542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:50.248814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:50.249624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] RBAC: Adding query filter params (role.id=7607d90167e342db84bf7531c1ee5b29, scope.project.id=88fc579e8d8f497ca9080c07ee56513e, user.id=eb5296b993844dd397ac68cd6babdd65) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:50.249932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:50.251328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca80542-dbd7-46a2-92ae-66aeba12a6e7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:50.256967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 562/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:50 2022] GET /identity/v3/role_assignments?user.id=eb5296b993844dd397ac68cd6babdd65&scope.project.id=88fc579e8d8f497ca9080c07ee56513e&role.id=7607d90167e342db84bf7531c1ee5b29 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:52.271784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992503fe-4c2b-49ca-937f-908392fefe3a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:52.272331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992503fe-4c2b-49ca-937f-908392fefe3a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:52.272441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992503fe-4c2b-49ca-937f-908392fefe3a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:52.273734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 569/1131] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:52.279313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:52.279708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:52.279868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:52.296710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:52.297876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:52.336994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:52.363330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 563/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:52.386056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992503fe-4c2b-49ca-937f-908392fefe3a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:52.479378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:52.488088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992503fe-4c2b-49ca-937f-908392fefe3a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:52.521134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81337401-834c-4c51-80ee-2f179464813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:52.521966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81337401-834c-4c51-80ee-2f179464813a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:52.522203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81337401-834c-4c51-80ee-2f179464813a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:52.522478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81337401-834c-4c51-80ee-2f179464813a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:52.523654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81337401-834c-4c51-80ee-2f179464813a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:52.525613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81337401-834c-4c51-80ee-2f179464813a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:52.527217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 570/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:52.533142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:52.629437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569d5b-d4b7-4769-90b1-90217b0c37a7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:52.662170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef35e-ec61-40cb-8431-972a799502f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:52.662818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef35e-ec61-40cb-8431-972a799502f6 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:52.663104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef35e-ec61-40cb-8431-972a799502f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:52.663380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef35e-ec61-40cb-8431-972a799502f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:52.664113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef35e-ec61-40cb-8431-972a799502f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:52.666067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef35e-ec61-40cb-8431-972a799502f6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:52.690585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 564/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:52 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:54.690914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9d87-869a-46e0-94d5-34a56bb498b3 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:54.691444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9d87-869a-46e0-94d5-34a56bb498b3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:54.691444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9d87-869a-46e0-94d5-34a56bb498b3 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:54.692927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 571/1135] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:54.698291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:54.698708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:54.698859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:54.715746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:54.716973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:54.737205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:54.782952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 565/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:54.807177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a9d87-869a-46e0-94d5-34a56bb498b3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:54.906134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a9d87-869a-46e0-94d5-34a56bb498b3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:54.937471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fec095-bc32-40c2-ae45-4f0a1d0e8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:54.938242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec095-bc32-40c2-ae45-4f0a1d0e8c8d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:54.938519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec095-bc32-40c2-ae45-4f0a1d0e8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:54.938790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec095-bc32-40c2-ae45-4f0a1d0e8c8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:54.939934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fec095-bc32-40c2-ae45-4f0a1d0e8c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:54.941416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fec095-bc32-40c2-ae45-4f0a1d0e8c8d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:54.942949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 572/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:54.949356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:55.044689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811cddd-5e51-4d5e-8684-ce45cd17e4e7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:55.077599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe688c4-87cf-4113-a98d-2565121868bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:55.078247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe688c4-87cf-4113-a98d-2565121868bc None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:55.078527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe688c4-87cf-4113-a98d-2565121868bc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:55.078801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe688c4-87cf-4113-a98d-2565121868bc None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:55.079507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe688c4-87cf-4113-a98d-2565121868bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:55.080958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe688c4-87cf-4113-a98d-2565121868bc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:55.100031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 566/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:41:54 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:57.137387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c487-6faf-4c49-9d54-957a9e0dcf0c None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:57.142048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c487-6faf-4c49-9d54-957a9e0dcf0c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:57.142048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c487-6faf-4c49-9d54-957a9e0dcf0c None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:57.142048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 573/1139] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:41:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:57.146129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:57.146547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:57.146683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:57.162964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:57.164170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:57.171852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:57.230197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 567/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:57.253455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c487-6faf-4c49-9d54-957a9e0dcf0c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:57.283417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:57.350669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c487-6faf-4c49-9d54-957a9e0dcf0c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:57.383132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:57.383904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:57.384215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:57.384490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:57.394373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:57.401874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:57.403011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:41:57.403908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 574/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:57.408818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:57.504111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dac7a1-0025-4b44-bfec-602ddca631b6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:57.536328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:57.536980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:57.537264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:57.537539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:57.538283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:57.538588 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:57.540646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:57.548403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 568/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:57.553968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:57.641890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:57.651726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356d49-ce8c-46fd-ad86-4f3a7b8690a8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:57.683876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:57.684763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:57.685043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:57.685312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] PATH_INFO: `/v3/users/ec936a8e7dab4a9ea79608fc8f45feca` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:57.697807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] RBAC: Authorizing `identity:get_user(user_id=ec936a8e7dab4a9ea79608fc8f45feca)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:57.699496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:57.701168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 575/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:57 2022] GET /identity/v3/users/ec936a8e7dab4a9ea79608fc8f45feca => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:57.706733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:57.710437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:57.803882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f150947-1834-4473-8041-ebc35f354f2c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:57.837045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:57.837677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:57.837961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:57.838236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:57.904347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:57.905786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:57.908374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:57.999955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 569/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:58.005707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:58.100047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790f347-f0ab-4819-90a3-31fa69824429 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:58.131514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7fbf6-1a2a-4b3f-97e0-0a78de6ea370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:58.132383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7fbf6-1a2a-4b3f-97e0-0a78de6ea370 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:58.132661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7fbf6-1a2a-4b3f-97e0-0a78de6ea370 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:58.132932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7fbf6-1a2a-4b3f-97e0-0a78de6ea370 None admin] PATH_INFO: `/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:58.134605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7fbf6-1a2a-4b3f-97e0-0a78de6ea370 None admin] RBAC: Authorizing `identity:get_project(project_id=efb7c6ae9cb84f8d80c0100f5ae62002)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:58.136007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7fbf6-1a2a-4b3f-97e0-0a78de6ea370 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:58.137682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 576/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:58 2022] GET /identity/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:58.143636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:58.238977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3166e4f-0d6a-4cad-be48-2fb5ebbba607 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:58.241145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:58.272316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:58.272952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:58.273228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:58.273500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:58.274338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=efb7c6ae9cb84f8d80c0100f5ae62002, user.id=ec936a8e7dab4a9ea79608fc8f45feca) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:58.274647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:58.276042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5dd89-1d28-4942-bfc9-f9c3e1ec27b1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:58.281264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 570/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:58 2022] GET /identity/v3/role_assignments?user.id=ec936a8e7dab4a9ea79608fc8f45feca&scope.project.id=efb7c6ae9cb84f8d80c0100f5ae62002&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:00.250032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e373ab-630a-4983-aa7d-af8b304dfcb8 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:00.250556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e373ab-630a-4983-aa7d-af8b304dfcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:00.250663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e373ab-630a-4983-aa7d-af8b304dfcb8 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:00.251951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 577/1147] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:00.257055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:00.257454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:00.257609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:00.274816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:00.275978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:00.339169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 571/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:00.360918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e373ab-630a-4983-aa7d-af8b304dfcb8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:00.379362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:00.460683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e373ab-630a-4983-aa7d-af8b304dfcb8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:00.493875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:00.494661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:00.494941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:00.495213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:00.505602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:00.513743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:00.514646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:00.515480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:42:00.520178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 578/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:00.521012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:00.621076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:00.625103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df664d61-f862-4b7f-b4ec-a18754662cc4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:00.659258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:00.659914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:00.660226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:00.660501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:00.661230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:00.661536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:00.662887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:00.672429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 572/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:00.676855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:00.755344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:00.776999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346787-b4f3-48d4-803a-5ac1f07655a0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:00.809085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:00.809934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:00.810218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:00.810494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] PATH_INFO: `/v3/users/ec936a8e7dab4a9ea79608fc8f45feca` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:00.811670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] RBAC: Authorizing `identity:get_user(user_id=ec936a8e7dab4a9ea79608fc8f45feca)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:00.813123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:00.814731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 579/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:42:00 2022] GET /identity/v3/users/ec936a8e7dab4a9ea79608fc8f45feca => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:00.821218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:00.918636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123056e-a61a-4e05-a00f-d3b047d07356 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:00.951696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0af06f-9a6c-4a36-b6db-be03976d070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:00.952564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af06f-9a6c-4a36-b6db-be03976d070a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:00.952842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af06f-9a6c-4a36-b6db-be03976d070a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:00.953114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af06f-9a6c-4a36-b6db-be03976d070a None admin] PATH_INFO: `/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:00.954266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af06f-9a6c-4a36-b6db-be03976d070a None admin] RBAC: Authorizing `identity:get_project(project_id=efb7c6ae9cb84f8d80c0100f5ae62002)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:00.955668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af06f-9a6c-4a36-b6db-be03976d070a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:00.957373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 573/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:42:00 2022] GET /identity/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:00.963291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:01.059794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b6ad-9730-461f-97ed-b3e77355fe93 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:01.091492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbfa42-ac88-45e2-88ef-ae843e42fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:01.092389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbfa42-ac88-45e2-88ef-ae843e42fc48 None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:01.092674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbfa42-ac88-45e2-88ef-ae843e42fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:01.092952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbfa42-ac88-45e2-88ef-ae843e42fc48 None admin] PATH_INFO: `/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002/users/ec936a8e7dab4a9ea79608fc8f45feca/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:01.094897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbfa42-ac88-45e2-88ef-ae843e42fc48 None admin] RBAC: Authorizing `identity:create_grant(project_id=efb7c6ae9cb84f8d80c0100f5ae62002, user_id=ec936a8e7dab4a9ea79608fc8f45feca, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:01.096344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbfa42-ac88-45e2-88ef-ae843e42fc48 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:01.110080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 580/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:42:00 2022] PUT /identity/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002/users/ec936a8e7dab4a9ea79608fc8f45feca/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:42:03.091893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816e357-7555-4d44-a629-cc3734c15565 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:03.092463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816e357-7555-4d44-a629-cc3734c15565 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:03.092557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816e357-7555-4d44-a629-cc3734c15565 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:03.093859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 574/1154] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:03.098982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:03.099395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:03.099550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:03.111541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:03.117167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:03.119716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:03.183812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 581/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:03.206767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816e357-7555-4d44-a629-cc3734c15565 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:03.235005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:03.307504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816e357-7555-4d44-a629-cc3734c15565 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:03.339844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:03.340642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:03.340927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:03.341202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:03.351057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:03.359182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:03.360325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:42:03.361371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 575/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:03.366313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:03.459942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371839b-2c11-4777-8bf6-ee79a1a6b8ef None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:03.491440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:03.492110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:03.492984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:03.493262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:03.494005 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:03.494313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:03.495675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:03.497779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:03.504371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 582/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:03.509930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:03.596752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:03.609402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674570-01f8-495e-8ba6-a8616f087070 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:03.641225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:03.642072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:03.642352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:03.642644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] PATH_INFO: `/v3/users/ec936a8e7dab4a9ea79608fc8f45feca` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:03.643799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] RBAC: Authorizing `identity:get_user(user_id=ec936a8e7dab4a9ea79608fc8f45feca)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:03.645228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:03.646821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 576/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:42:03 2022] GET /identity/v3/users/ec936a8e7dab4a9ea79608fc8f45feca => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:03.652928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:03.748357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed75fa-f03c-412f-8bd9-98ce5cb2b532 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:03.779822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:03.780481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:03.780763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:03.781037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:03.842336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:03.846401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:03.847831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:03.940576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 583/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:03.946770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:04.042481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c73d-bb13-4462-8dfb-9ddafda8fc77 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:04.074430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c8de-8294-493d-afc9-5c6aee9f037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:04.075262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c8de-8294-493d-afc9-5c6aee9f037a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:04.075536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c8de-8294-493d-afc9-5c6aee9f037a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:04.075803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c8de-8294-493d-afc9-5c6aee9f037a None admin] PATH_INFO: `/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:04.076988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c8de-8294-493d-afc9-5c6aee9f037a None admin] RBAC: Authorizing `identity:get_project(project_id=efb7c6ae9cb84f8d80c0100f5ae62002)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:04.078391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c8de-8294-493d-afc9-5c6aee9f037a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:04.080034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 577/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:42:03 2022] GET /identity/v3/projects/efb7c6ae9cb84f8d80c0100f5ae62002 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:04.085874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:04.177019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:04.180785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e0b4d-06fd-4ae9-b55e-c20628c04ae3 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:04.214207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:04.214835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:04.215113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:04.215385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:04.216226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=efb7c6ae9cb84f8d80c0100f5ae62002, user.id=ec936a8e7dab4a9ea79608fc8f45feca) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:04.216536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:04.217932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e3fff-1b2b-41dd-9bdd-8cb25eda2af3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:04.223469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 584/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:42:04 2022] GET /identity/v3/role_assignments?user.id=ec936a8e7dab4a9ea79608fc8f45feca&scope.project.id=efb7c6ae9cb84f8d80c0100f5ae62002&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:06.246117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c27f-b04e-46f5-9e4c-8d29c5a03424 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:06.246658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c27f-b04e-46f5-9e4c-8d29c5a03424 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:06.246658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c27f-b04e-46f5-9e4c-8d29c5a03424 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:06.248028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 578/1162] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:06.253156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:06.253573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:06.253707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:06.270027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:06.271199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:06.335068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 585/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:42:06.357899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540c27f-b04e-46f5-9e4c-8d29c5a03424 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:06.383131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:06.456896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540c27f-b04e-46f5-9e4c-8d29c5a03424 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:06.489518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:06.490151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:06.490435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:06.490713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:06.555851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:06.557272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:06.580729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:06.652334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 579/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:06.658348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:06.744797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:06.753641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dfa60-900f-4c59-8019-6ffbda45c151 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:06.786226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:06.787009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:06.787292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:06.787566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:06.794071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:06.795508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-a1117a63-1a8c-40d0-aef7-7ebe59b062b3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:06.809936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:06.811119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:42:06.812235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 586/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:42:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:06.816919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:06.911578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8aa6-916c-42e5-925f-cffc73169c1e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:06.934738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:06.945645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:06.946299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:06.946585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:06.946864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:06.947576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:06.947887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:06.949534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0687af-9a09-462a-8454-d6ed82613fde None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:06.956521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 580/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 14 10:42:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:08.966624 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245302-9324-463c-aff7-8682090622a7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:08.967130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245302-9324-463c-aff7-8682090622a7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:08.967240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245302-9324-463c-aff7-8682090622a7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:08.968597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 587/1167] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:08.973649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351e9b6-e50e-4d11-a689-5f5767203c76 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:08.974015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351e9b6-e50e-4d11-a689-5f5767203c76 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:08.974222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351e9b6-e50e-4d11-a689-5f5767203c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:08.991233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1351e9b6-e50e-4d11-a689-5f5767203c76 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:08.992471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1351e9b6-e50e-4d11-a689-5f5767203c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:09.057614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 581/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:09.080769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245302-9324-463c-aff7-8682090622a7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:09.177803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245302-9324-463c-aff7-8682090622a7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:09.218875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571deedb-459a-410d-812f-b5678740c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:09.219521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571deedb-459a-410d-812f-b5678740c935 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:09.219805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571deedb-459a-410d-812f-b5678740c935 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:09.220103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571deedb-459a-410d-812f-b5678740c935 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:09.220845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571deedb-459a-410d-812f-b5678740c935 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:09.222199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571deedb-459a-410d-812f-b5678740c935 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:09.236365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 588/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Jul 14 10:42:09 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:42:11.251034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eba7c-890a-4c60-9522-838060dd561a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:11.251615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eba7c-890a-4c60-9522-838060dd561a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:11.251615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eba7c-890a-4c60-9522-838060dd561a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:11.252969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 582/1170] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:11.258215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:11.258637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:11.258770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:11.277078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:11.278246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:11.285546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:11.345710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 589/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:11.369876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eba7c-890a-4c60-9522-838060dd561a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:11.468330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eba7c-890a-4c60-9522-838060dd561a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:11.485259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:11.502150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a515259-2add-4fdd-918b-26ec089639fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:11.502934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515259-2add-4fdd-918b-26ec089639fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:11.503214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515259-2add-4fdd-918b-26ec089639fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:11.503484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515259-2add-4fdd-918b-26ec089639fe None admin] PATH_INFO: `/v3/domains/dd07e47a89be4b15bfb2e92acbe0fd62` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:11.513611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a515259-2add-4fdd-918b-26ec089639fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=dd07e47a89be4b15bfb2e92acbe0fd62)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:11.515049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a515259-2add-4fdd-918b-26ec089639fe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:11.516694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 583/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 14 10:42:11 2022] GET /identity/v3/domains/dd07e47a89be4b15bfb2e92acbe0fd62 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:11.522480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:11.622902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c06956-2dbb-4d95-9d75-d9419a292612 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:11.654994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9685f-92d1-47f7-aa2d-cd885c12825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:11.655647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9685f-92d1-47f7-aa2d-cd885c12825e None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:11.655932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9685f-92d1-47f7-aa2d-cd885c12825e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:11.656239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9685f-92d1-47f7-aa2d-cd885c12825e None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:11.656955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9685f-92d1-47f7-aa2d-cd885c12825e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:11.658373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9685f-92d1-47f7-aa2d-cd885c12825e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:11.671229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:11.683053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 590/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:42:11 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:42:13.690820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2336d-b296-467f-95a9-51953ba2ee7a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:13.691378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2336d-b296-467f-95a9-51953ba2ee7a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:13.691378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2336d-b296-467f-95a9-51953ba2ee7a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:13.692786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 584/1174] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:13.698576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:13.699010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:13.699137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:13.716140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:13.717323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:13.780745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 591/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:13.805202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2336d-b296-467f-95a9-51953ba2ee7a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:13.905394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2336d-b296-467f-95a9-51953ba2ee7a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:13.937565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66021e47-f335-453e-b50e-dd078b7732ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:13.938408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021e47-f335-453e-b50e-dd078b7732ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:13.938693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021e47-f335-453e-b50e-dd078b7732ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:13.938972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66021e47-f335-453e-b50e-dd078b7732ea None admin] PATH_INFO: `/v3/domains/dd07e47a89be4b15bfb2e92acbe0fd62` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:13.940178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66021e47-f335-453e-b50e-dd078b7732ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=dd07e47a89be4b15bfb2e92acbe0fd62)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:13.941652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66021e47-f335-453e-b50e-dd078b7732ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:13.943212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 585/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 14 10:42:13 2022] GET /identity/v3/domains/dd07e47a89be4b15bfb2e92acbe0fd62 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:13.949760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:14.044921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2d5d-3e61-4c12-8b1c-a2b2c715ee93 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:14.068022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:14.080040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1a5b-eae0-4e9c-9c6d-b4a16b6820fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:14.080728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1a5b-eae0-4e9c-9c6d-b4a16b6820fd None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:14.081011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1a5b-eae0-4e9c-9c6d-b4a16b6820fd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:14.081287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1a5b-eae0-4e9c-9c6d-b4a16b6820fd None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:14.081986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb1a5b-eae0-4e9c-9c6d-b4a16b6820fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:14.083415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb1a5b-eae0-4e9c-9c6d-b4a16b6820fd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:14.101958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 592/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:42:13 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:42:16.137138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14d7d5-b199-41e7-85a2-a7620d02a07c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:16.137661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14d7d5-b199-41e7-85a2-a7620d02a07c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:16.137661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14d7d5-b199-41e7-85a2-a7620d02a07c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:16.138972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 586/1178] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:16.143978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:16.144381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:16.144565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:16.161491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:16.162652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:16.226684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 593/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:42:16.250328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14d7d5-b199-41e7-85a2-a7620d02a07c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:16.297109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:16.350295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14d7d5-b199-41e7-85a2-a7620d02a07c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:16.382964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:16.383731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:16.384014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:16.384322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:16.394263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:16.402387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:16.403547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:42:16.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 587/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:16.409784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:16.503831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a256a1-4474-450d-8cdf-ee97e8f21a0e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:16.513882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:16.537947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:16.538713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:16.539652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:16.540049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:16.540933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:16.541367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:16.542860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:16.550826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 594/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:16.556496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:16.666316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e27b-c85f-4803-8c7e-d98219f5d034 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:16.673238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:16.700505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:16.701366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:16.701646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:16.701922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] PATH_INFO: `/v3/users/fb9edae672e543da869870afc2893eec` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:16.715128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=fb9edae672e543da869870afc2893eec)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:16.716586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:16.718214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 588/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:42:16 2022] GET /identity/v3/users/fb9edae672e543da869870afc2893eec => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:16.723974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:16.819140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbd17-a981-4bd0-b4ac-27918a008ab0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:16.852169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:16.852797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:16.853079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:16.853361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:16.892659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:16.918287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:16.919662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:17.023833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 595/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:17.029917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:17.127284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1ff7e-f384-4b7d-98f8-e61621cd1ca5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:17.160071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811ced9-b0b0-42a3-8c77-6801692a2c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:17.160936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ced9-b0b0-42a3-8c77-6801692a2c74 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:17.161217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ced9-b0b0-42a3-8c77-6801692a2c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:17.161489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ced9-b0b0-42a3-8c77-6801692a2c74 None admin] PATH_INFO: `/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:17.162663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811ced9-b0b0-42a3-8c77-6801692a2c74 None admin] RBAC: Authorizing `identity:get_project(project_id=d84b8970e8c1450d9bada2cd3b2437ef)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:17.164725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811ced9-b0b0-42a3-8c77-6801692a2c74 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:17.166410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 589/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:42:17 2022] GET /identity/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:17.172598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:17.239132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:17.267469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0298b77-1fc3-482e-b822-a5e774c7fc9d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:17.300993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:17.301635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:17.301918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:17.302193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:17.303008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=d84b8970e8c1450d9bada2cd3b2437ef, user.id=fb9edae672e543da869870afc2893eec) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:17.303319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:17.305060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5f928-861d-4b90-a4b1-b6d220e4a0c8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:17.310293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 596/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:42:17 2022] GET /identity/v3/role_assignments?user.id=fb9edae672e543da869870afc2893eec&scope.project.id=d84b8970e8c1450d9bada2cd3b2437ef&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:19.291946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf36d2-cef5-4997-bf99-74f3a3c62d88 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:19.292534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf36d2-cef5-4997-bf99-74f3a3c62d88 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:19.292534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf36d2-cef5-4997-bf99-74f3a3c62d88 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:19.293874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 590/1186] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:19.299034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:19.299461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:19.299588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:19.316468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:19.317626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:19.380540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 597/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:19.402541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf36d2-cef5-4997-bf99-74f3a3c62d88 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:19.432742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:19.501730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf36d2-cef5-4997-bf99-74f3a3c62d88 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:19.534563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:19.535339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:19.535621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:19.535897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:19.546472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:19.553955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:19.555032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:42:19.556107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 591/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:19.561119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:19.621985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:19.655349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b1b6d-520c-4221-80a1-8d1da6b086ff None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:19.688738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:19.689637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:19.689922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:19.690191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:19.690923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:19.691225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:19.692594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:19.701086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 598/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:19.706741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:19.795155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:19.804036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00bb55-c126-4b43-b8ed-94f46c72a902 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:19.837094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:19.837943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:19.838223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:19.838499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] PATH_INFO: `/v3/users/fb9edae672e543da869870afc2893eec` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:19.839677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] RBAC: Authorizing `identity:get_user(user_id=fb9edae672e543da869870afc2893eec)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:19.841120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:19.842726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 592/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:42:19 2022] GET /identity/v3/users/fb9edae672e543da869870afc2893eec => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:19.848665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:19.946158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284aa87-db4e-4edd-9df1-783e86df4b69 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:19.972264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:19.980442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34704-2ce2-491c-a687-8d841ab6b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:19.981297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34704-2ce2-491c-a687-8d841ab6b380 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:19.981579 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34704-2ce2-491c-a687-8d841ab6b380 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:19.981849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34704-2ce2-491c-a687-8d841ab6b380 None admin] PATH_INFO: `/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:19.983016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34704-2ce2-491c-a687-8d841ab6b380 None admin] RBAC: Authorizing `identity:get_project(project_id=d84b8970e8c1450d9bada2cd3b2437ef)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:19.984463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34704-2ce2-491c-a687-8d841ab6b380 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:19.986168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 599/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:42:19 2022] GET /identity/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:19.992634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:20.089899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a34dfa-dd33-4377-8494-39a1fbef2b8f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:20.122337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e0d4-2dbb-4dd5-9253-38ad7eedcade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:20.123207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e0d4-2dbb-4dd5-9253-38ad7eedcade None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:20.123490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e0d4-2dbb-4dd5-9253-38ad7eedcade None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:20.123768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e0d4-2dbb-4dd5-9253-38ad7eedcade None admin] PATH_INFO: `/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef/users/fb9edae672e543da869870afc2893eec/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:20.125741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e0d4-2dbb-4dd5-9253-38ad7eedcade None admin] RBAC: Authorizing `identity:create_grant(project_id=d84b8970e8c1450d9bada2cd3b2437ef, user_id=fb9edae672e543da869870afc2893eec, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:20.127158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e0d4-2dbb-4dd5-9253-38ad7eedcade None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:20.140042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 593/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:42:19 2022] PUT /identity/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef/users/fb9edae672e543da869870afc2893eec/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:42:22.125521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3649c7e-bda9-437d-9ec2-7d22ea3dbefc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:22.126020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3649c7e-bda9-437d-9ec2-7d22ea3dbefc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:22.126020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3649c7e-bda9-437d-9ec2-7d22ea3dbefc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:22.127406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 600/1193] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:22.132616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:22.132989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:22.133160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:22.149568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:22.150736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:22.164679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:22.216642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 594/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:22.241381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3649c7e-bda9-437d-9ec2-7d22ea3dbefc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:22.338986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3649c7e-bda9-437d-9ec2-7d22ea3dbefc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:22.371432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:22.372234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:22.372522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:22.372807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:22.382652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:22.390251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:22.391372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:42:22.392518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 601/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:22.399572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:22.495758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cbdc7-9b9f-4a51-b665-8a1d453ef583 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:22.528430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:22.529090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:22.529375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:22.529653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:22.530400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:22.530709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:22.532151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:22.540492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 595/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:22.546069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:22.600789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:22.644003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3f5e-8e0e-408b-b95e-6089460a1555 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:22.676683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:22.677541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:22.677827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:22.678108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] PATH_INFO: `/v3/users/fb9edae672e543da869870afc2893eec` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:22.679318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] RBAC: Authorizing `identity:get_user(user_id=fb9edae672e543da869870afc2893eec)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:22.680777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:22.682395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 602/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 14 10:42:22 2022] GET /identity/v3/users/fb9edae672e543da869870afc2893eec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:22.688112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:22.704261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:22.785877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3505-887c-4052-845f-5c1f2fbab57b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:22.817141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:22.817769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:22.818048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:22.818317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:22.884555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:22.885985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:22.900602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:22.982028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 596/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:22.987865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:23.085713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0aac9-f4b3-48c2-899e-aa366e7d7860 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:23.107305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:23.118429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a307d4-37a5-46b2-ad22-6cbc9ce8bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:23.119273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a307d4-37a5-46b2-ad22-6cbc9ce8bd75 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:23.119559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a307d4-37a5-46b2-ad22-6cbc9ce8bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:23.119836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a307d4-37a5-46b2-ad22-6cbc9ce8bd75 None admin] PATH_INFO: `/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:23.121031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a307d4-37a5-46b2-ad22-6cbc9ce8bd75 None admin] RBAC: Authorizing `identity:get_project(project_id=d84b8970e8c1450d9bada2cd3b2437ef)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:23.122448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a307d4-37a5-46b2-ad22-6cbc9ce8bd75 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:23.124141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 603/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 14 10:42:22 2022] GET /identity/v3/projects/d84b8970e8c1450d9bada2cd3b2437ef => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:23.130982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:23.225926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a83ac-713f-4a35-9f15-6ec44f1a49aa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:23.247389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:23.269490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:23.270148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:23.270434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:23.270714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:23.271545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=d84b8970e8c1450d9bada2cd3b2437ef, user.id=fb9edae672e543da869870afc2893eec) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:23.271863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:23.273369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc10493-8490-40dc-8ab5-755739e755ee None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:23.279214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 597/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:42:23 2022] GET /identity/v3/role_assignments?user.id=fb9edae672e543da869870afc2893eec&scope.project.id=d84b8970e8c1450d9bada2cd3b2437ef&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:33.113806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:33.276533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=12 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:18.009352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b2b3-8f2c-4cff-9a04-db732039d5fa None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:18.010082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b2b3-8f2c-4cff-9a04-db732039d5fa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:18.010082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b2b3-8f2c-4cff-9a04-db732039d5fa None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:18.011418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 604/1201] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:18.019027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:18.019970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:18.020466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:18.051648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:18.055570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:18.143386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 598/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:18.175014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b2b3-8f2c-4cff-9a04-db732039d5fa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:18.321967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b2b3-8f2c-4cff-9a04-db732039d5fa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:18.365922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:18.366819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:18.367167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:18.367446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:18.380313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:18.381977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:18.402786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:18.408299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:18.409729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:18.409729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:18.409729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:18.409729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:18.409729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 605/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:18.410620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:18.548944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7ddc3-6b01-4e66-8c1b-a1a50fe15011 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:18.588011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:18.597514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:18.599375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:18.600240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:18.600526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:18.601398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:18.601774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:18.603260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138255e-e61c-4027-b28a-a44f9f644048 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:18.616043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 599/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:18.622477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:18.684651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:18.751290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509743-c35a-4de3-b2fc-5584a86c51e9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:18.787718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b3a8-6927-423c-bd48-8e13432048d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:18.788562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b3a8-6927-423c-bd48-8e13432048d7 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:18.788863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b3a8-6927-423c-bd48-8e13432048d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:18.789125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b3a8-6927-423c-bd48-8e13432048d7 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:18.789831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359b3a8-6927-423c-bd48-8e13432048d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:18.791348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359b3a8-6927-423c-bd48-8e13432048d7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:18.820173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 606/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 14 10:43:18 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:43:20.953488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf365-eb3e-4495-b645-fa43fe9cda8b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:20.954008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf365-eb3e-4495-b645-fa43fe9cda8b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:20.954150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf365-eb3e-4495-b645-fa43fe9cda8b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:20.955445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 600/1206] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:20.961703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:20.962151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:20.962264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:20.981026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:20.982479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:21.069510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 607/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:21.093750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf365-eb3e-4495-b645-fa43fe9cda8b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:21.216094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf365-eb3e-4495-b645-fa43fe9cda8b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:21.253879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:21.254825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:21.255105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:21.255417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:21.273165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:21.283587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:21.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:21.285724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 601/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:43:21.288527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:21.336792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:21.413417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7bf75-fdce-4406-94ec-28aa05b012ab None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:21.453271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:21.454109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:21.454401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:21.454833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:21.455619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:21.456116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:21.457892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:21.468882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 608/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:21.474585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:21.537716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:21.602106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c99ef-4052-4ea4-8e5e-c2c941b220a8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:21.647162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:21.647962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:21.648268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:21.648541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:21.660616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:21.662298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:21.686918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:21.689033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:21.689922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:21.689922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:21.689922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:21.689922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:21.689922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 602/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:43:21.695470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:21.809696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:21.814516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc9c92-c306-4f08-9dea-4c2b7fe89949 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:21.863224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:21.863224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:21.863224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:21.863574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:21.864090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:21.864408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:21.866377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:21.881380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 609/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:21.887128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:22.011884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227254-7f5a-4688-a767-77e980ceda0d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:22.013948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:22.053143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:22.053996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:22.054275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:22.054552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:22.063507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:22.064923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:22.082063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:22.083133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:22.084544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 603/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:22.090159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:22.223577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8431-5821-4d35-b78a-f83fe3d2ba4d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:22.261166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:22.261830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:22.262109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:22.262411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:22.263339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:22.263699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:22.265401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:22.289319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 610/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:22.296796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:22.416960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bd7b4-f6db-4211-a880-d1c03d37e562 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:22.455306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:22.455960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:22.456308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:22.456545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:22.490565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:22.534161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:22.536382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:22.662608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 604/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:43:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:43:22.669248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:22.691758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:22.789376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe4ad-8531-4b15-8e0e-f7b880a62839 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:22.828317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:22.829204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:22.829551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:22.829894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:22.842062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:22.843947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:22.864465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:22.865572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:22.866754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:22.866754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:22.866754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:22.866754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:22.866754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 611/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:22.872483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:22.944897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:22.987445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818a54a-ca1a-4909-b6d3-4d6258d34261 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:23.028087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:23.029860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:23.030121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:23.030401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:23.031336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:23.031749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:23.033185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:23.051724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 605/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:23.052838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:23.133274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:23.177173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc231f0-7ef2-48bb-a70a-a056fefad95d None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:23.217628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:23.218698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:23.219144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:23.219587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:23.227290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:23.228906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:23.244348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:23.245507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:23.246778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:23.253883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 612/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:23.256046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:23.382705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922727-7bd6-4863-8a62-4f542c261025 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:23.414037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:23.426922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:23.428304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:23.428695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:23.429090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:23.429971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:23.430385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:23.431902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0134aa-da14-43bb-a64c-c9a016e78b62 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:23.445072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 606/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:23.451579 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:23.565238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3554ad-bf55-4ec3-91e7-13f6747536ed None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:23.598892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:23.606668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:23.607081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:23.607409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:23.607853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:23.608735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=005d2ffd11584aaca47ba71a8bc2811a) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:23.609048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:23.610496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec0f5-29dc-4015-bde5-eacd30b02d27 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:23.616772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 613/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:43:23 2022] GET /identity/v3/role_assignments?user.id=005d2ffd11584aaca47ba71a8bc2811a&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:25.838569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2dae-da9d-40f4-bab6-90cfaebc9aa5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:25.839245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2dae-da9d-40f4-bab6-90cfaebc9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:25.839245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2dae-da9d-40f4-bab6-90cfaebc9aa5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:25.841261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 607/1220] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:25.847521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:25.848013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:25.848144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:25.870009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:25.871570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:25.944160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 614/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:43:25.967695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2dae-da9d-40f4-bab6-90cfaebc9aa5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:26.076391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2dae-da9d-40f4-bab6-90cfaebc9aa5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:26.112983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:26.113948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:26.114286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:26.114754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:26.126452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:26.135418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:26.136574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:26.137463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 608/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:43:26.143357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:26.247027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee0ff6-d2f5-4006-843f-27cd244973d7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:26.272791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:26.285879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:26.286541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:26.286844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:26.287725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:26.288737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] RBAC: Adding query filter params (name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:26.289111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:26.291022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:26.300448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 615/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:26.306205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:26.356007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:26.417983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1b90a-1992-4743-a51f-c4aa20d463f8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:26.458124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:26.459007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:26.459287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:26.459562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:26.470680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:26.472152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:26.490995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:26.492183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:26.493666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:26.493666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:26.493666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:26.493666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:26.493666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 609/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:26.497887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:26.606318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8176609-518b-4971-8309-5684e95dd34a None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:26.644254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:26.644990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:26.645276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:26.645587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:26.647033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:26.647348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:26.649028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:26.665329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 616/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:26.671731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:26.775548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:26.783404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec6e6-91c4-4f45-b8a1-35b6ce2df566 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:26.821420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:26.824181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:26.824181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:26.824181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:26.830664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:26.832175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:26.846516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:26.848227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:26.849169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 610/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:26.853799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:26.907667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:26.967516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0dc05-368f-4676-b330-8ca763e305f2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:27.009247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:27.010063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:27.010352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:27.010667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:27.011822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:27.012253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:27.014029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:27.035671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 617/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:27.041578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:27.150309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9186fa-2908-4b7e-91c7-6d471dea0350 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:27.186703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:27.187518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:27.187852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:27.188241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:27.200714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:27.202246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:27.219882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:27.220852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:27.222707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:27.222707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:27.222707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:27.222707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:27.222707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 611/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:43:27.228239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:27.334238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ce1ad-38d0-492b-827a-0aaa762319bd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:27.336611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:27.371721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:27.372520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:27.372818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:27.373120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:27.373968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:27.374432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:27.376285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:27.390080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 618/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:27.396091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:27.406718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:27.508811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fe829-c14c-4363-8c71-ad94693e2a81 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:27.545792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:27.546582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:27.546864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:27.547138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:27.554394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:27.555824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:27.572123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:27.573244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:27.574555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 612/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:27.579615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:27.694841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ad804-db94-4322-9e87-aa3fa92ccdff None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:27.729722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:27.730454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:27.730788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:27.731066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:27.731938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:27.732278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:27.733806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5500cb-f019-4921-a0c4-9f2fb0ebd22a None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:27.747388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 619/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:27.754428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:27.836300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:27.879670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bb160-35b8-4a74-ac74-40e1fbc8ebf2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:27.932124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f4960-42c1-4a8b-a033-d9744bb11dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:27.933178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4960-42c1-4a8b-a033-d9744bb11dd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:27.933520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4960-42c1-4a8b-a033-d9744bb11dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:27.933930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4960-42c1-4a8b-a033-d9744bb11dd1 None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/005d2ffd11584aaca47ba71a8bc2811a/roles/8b09bb7457f04954826acda90889a3f6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:27.950345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f4960-42c1-4a8b-a033-d9744bb11dd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=005d2ffd11584aaca47ba71a8bc2811a, role_id=8b09bb7457f04954826acda90889a3f6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:27.952230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f4960-42c1-4a8b-a033-d9744bb11dd1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:27.965016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 613/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:43:27 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/005d2ffd11584aaca47ba71a8bc2811a/roles/8b09bb7457f04954826acda90889a3f6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:43:30.224273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51874cd7-41e6-4624-9035-77d8d43806d1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:30.224914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51874cd7-41e6-4624-9035-77d8d43806d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:30.224914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51874cd7-41e6-4624-9035-77d8d43806d1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:30.226457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 620/1233] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:43:30.232311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:30.232767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:30.232858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:30.250746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:30.252209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:30.330661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 614/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:30.357318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51874cd7-41e6-4624-9035-77d8d43806d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:30.384257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:30.471282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51874cd7-41e6-4624-9035-77d8d43806d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:30.516006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:30.516760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:30.517059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:30.517317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:30.527561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:30.535213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:30.536195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:30.537079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 621/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 14 10:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:30.542601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:30.591026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:30.652420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a838f-1558-4b29-9e9e-507e64999a12 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:30.692048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:30.692847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:30.693797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:30.694138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:30.695003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:30.695335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:30.696739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:30.705353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 615/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 14 10:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:30.711468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:30.807581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:30.824848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a492e-4aca-4eb1-9e79-64abb77d6ba2 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:30.862020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:30.862830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:30.863113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:30.863388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:30.875645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:30.877193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:30.895396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:30.896442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:30.897762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:30.897762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:30.897762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:30.897762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:30.897762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 622/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:30.902509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:31.016742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caca6cc-155a-413e-bf8e-5a7f86a769f6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:31.026148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:31.053871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:31.054561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:31.054852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:31.055129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:31.055846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:31.056195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:31.057556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:31.070013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 616/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:31.076777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:31.181609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5eccd-3904-4090-bf29-44e4c5f3ce80 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:31.221233 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:31.222142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:31.222342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:31.222641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:31.225845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:31.232356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:31.234201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:31.250767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:31.251873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:31.252827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 623/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:31.258537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:31.375053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c4cbd-d5a9-456c-9cc2-46f12e8792f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:31.414501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:31.415169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:31.415448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:31.415722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:31.416590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:31.416900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:31.418315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:31.437783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 617/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:31.443705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:31.559619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a69ac-6952-4c7b-bc9d-5a5c424ae017 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:31.599325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:31.600306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:31.600663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:31.601029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:31.675419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:31.684581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:31.686783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:31.810216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 624/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:43:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:43:31.817798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:31.849981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:31.936645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543837df-5554-442d-881a-fd419a2a7c28 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:31.980131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:31.980823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:31.981118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:31.981368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:31.994307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:31.995899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:32.015624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:32.016945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:32.017868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:32.017868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:32.017868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:32.017868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:32.017868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 618/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:32.023404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:32.126821 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:32.134053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e836e8-e9a1-44d5-9f6d-53a03469fcf1 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:32.169662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:32.170696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:32.171065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:32.171427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:32.172248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:32.172561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:32.173926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:32.189157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 625/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:32.195230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:32.278404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:32.301800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b944-95d8-4fdb-b04e-69f1b26d09e9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:32.339923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:32.340792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:32.341080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:32.341402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:32.350825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:32.352316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:32.368336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:32.369711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:32.370857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 619/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:32.376954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:32.494054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2d3e-ab1b-41d8-a187-776813f8fa1e None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:32.533612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:32.534397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:32.534822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:32.535113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:32.536003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:32.536416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:32.537882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112669-0041-4e44-9c0f-6c4d7bb4b733 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:32.551253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 626/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:32.557870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:32.677479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67329b16-1902-41f1-a4bf-a8a4ddb31457 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:32.715604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:32.716384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:32.716592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:32.716868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:32.717759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] RBAC: Adding query filter params (role.id=8b09bb7457f04954826acda90889a3f6, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=005d2ffd11584aaca47ba71a8bc2811a) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:32.718065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:32.719501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ee73-9fe6-439e-80be-983718837f92 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:32.726221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 620/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:43:32 2022] GET /identity/v3/role_assignments?user.id=005d2ffd11584aaca47ba71a8bc2811a&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=8b09bb7457f04954826acda90889a3f6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:35.010491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544b22-2c60-410c-a02a-3fedd686fe0b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.011079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544b22-2c60-410c-a02a-3fedd686fe0b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.011079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544b22-2c60-410c-a02a-3fedd686fe0b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:35.012454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 627/1247] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:35.017819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.018268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.018382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:35.023451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:35.036771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:35.037979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:35.118538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 621/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:35.143769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98544b22-2c60-410c-a02a-3fedd686fe0b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:35.163409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:35.254736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98544b22-2c60-410c-a02a-3fedd686fe0b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:35.295091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:35.295914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.296234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.296511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:35.307878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:35.315453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:35.316531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:35.317350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 628/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:35.322925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:35.433115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256493-4b6e-42d7-a81f-85f1888a5b2e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:35.463672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:35.469920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:35.470800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.471132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.471764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:35.472564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:35.472881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:35.474908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:35.484789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 622/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:35.492043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:35.577774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:35.601539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447be0-656d-49dc-aeb0-c1402d7b7803 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:35.636832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:35.637601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.637883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.638153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:35.649193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:35.650672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:35.669068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:35.670231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:35.671206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:35.671206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:35.671206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:35.671206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:35.671206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 629/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:35.676354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:35.785954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55128-abec-4596-9439-9017a586e2e7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:35.823055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:35.823976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.824289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.824566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:35.825279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:35.825601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:35.826939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:35.840538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 623/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:35.846419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:35.960014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365199a-9761-4e62-8d13-94962d345924 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:35.989057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:35.998415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:35.999254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:35.999602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:35.999880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:36.008557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:36.010035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:36.026595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:36.028693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:36.030145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 630/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:43:36.034166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:36.096712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:36.145648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec82bf8-81c4-4008-a1c9-62ba6f743c1a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:36.183986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:36.184679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:36.184961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:36.185237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:36.186065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:36.186366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:36.187788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:36.210660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 624/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:36.212133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:36.320481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3af1-4207-40da-b820-7a591ed0a22b None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:36.358334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:36.358910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:36.359191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:36.359466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:36.418205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:36.430541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:36.431994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:36.536927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 631/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:43:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:43:36.542758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:36.676629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35972f-a566-4325-ab80-fc5e887df995 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:36.699980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:36.729820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:36.730771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:36.731089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:36.731370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:36.743879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:36.745610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:36.764656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:36.765732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:36.766646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:36.766646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:36.766646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:36.766646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:36.766646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 625/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:36.772082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:36.870507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:36.887620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3012415-fc66-4b8e-82a2-e6931cfd4178 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:36.924475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:36.925140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:36.925440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:36.925870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:36.926739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:36.926994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:36.929143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:36.940128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 632/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:36.946932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:37.054091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeef62-1321-416e-acb4-d1cd4169ad10 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:37.090163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0781038-1570-47d1-854b-362336565f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:37.091012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0781038-1570-47d1-854b-362336565f42 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:37.091314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0781038-1570-47d1-854b-362336565f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:37.091658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0781038-1570-47d1-854b-362336565f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:37.099483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0781038-1570-47d1-854b-362336565f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:37.100961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0781038-1570-47d1-854b-362336565f42 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b0781038-1570-47d1-854b-362336565f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:37.114755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:37.116021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:37.117293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 626/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:37.122049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:37.231648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa653b-8778-4f6a-be9e-af8cba6afdbd None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:37.268992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:37.269668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:37.269953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:37.270228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:37.271557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:37.271866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:37.273369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8611-1907-4ef6-a233-d7c16f33e7eb None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:37.287521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 633/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:37.293780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0781038-1570-47d1-854b-362336565f42 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:37.321580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:37.401210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0781038-1570-47d1-854b-362336565f42 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:37.436981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:37.437651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:37.437935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:37.438213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:37.439068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=005d2ffd11584aaca47ba71a8bc2811a) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:37.439384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:37.440883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3108362-c8df-43c2-b393-5a309ef93d50 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:37.460099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 627/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:43:37 2022] GET /identity/v3/role_assignments?user.id=005d2ffd11584aaca47ba71a8bc2811a&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=195f05d542f14d7b93230878b428d9eb => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:39.467991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c14e6-397e-4431-abcb-65b935649833 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:39.468607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c14e6-397e-4431-abcb-65b935649833 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:39.468607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c14e6-397e-4431-abcb-65b935649833 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:39.469928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 634/1261] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:39.475120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:39.475540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:39.475673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:39.492496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:39.493665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:39.557160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 628/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:43:39.579880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c14e6-397e-4431-abcb-65b935649833 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:39.590431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:39.683125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c14e6-397e-4431-abcb-65b935649833 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:39.718182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:39.718902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:39.719185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:39.719463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:39.729322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:39.737024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:39.738118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:39.739350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 635/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:39.744885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:39.763132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:39.841218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d0886-9a24-4bea-a186-460658e706c3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:39.875442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:39.876134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:39.876418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:39.876696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:39.877443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:39.877751 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:39.879116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:39.887158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 629/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:39.892750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:39.956940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:39.990611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ef3f-a40f-49da-aa84-cbbf1e601d9c None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.022886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.023661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.023945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.024251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:40.034519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:40.035949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:40.053654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:40.054720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:40.055897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:40.055897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:40.055897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:40.055897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:40.055897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 636/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:40.060637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:40.138679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:40.157300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e21d0-af4d-4766-b059-c10bdb0c25f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.190327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.190965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.191246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.191521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:40.192264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:40.192570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:40.193946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:40.205617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 630/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:40.211565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:40.307313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beef7f-beb1-4e35-9939-2a003ffa9334 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.325863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:40.339908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.340721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.341006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.341282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:40.348427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:40.350461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:40.364358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:40.365530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:40.366885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 637/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:40.372096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:40.467901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36dbf6-6217-4cdc-93bc-2c7aafaeda2e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.500882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.501545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.501827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.502103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:40.502934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:40.503247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:40.504700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:40.513103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:40.522346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 631/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:40.528431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:40.632621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717fb32-6ca5-4e79-8687-eaa220b2bbd8 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.668188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.669021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.669300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.669574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:40.679807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:40.681256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:40.698043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:40.699347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:40.700477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:40.700477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:40.700477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:40.700477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:40.700477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 638/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:40.705176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:40.809098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac723bf4-7a27-455c-9c3b-8059cb380c9e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.842886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.843541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.843825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.844130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:40.844852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:40.845162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:40.846523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:40.857474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 632/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:40.863162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:40.894454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:40.961308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7923a7-0e73-4d5a-b4c2-08a93ff209c0 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:40.993537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:40.994319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:40.994606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:40.994883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:41.001380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:41.002820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:41.017340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:41.018362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:41.019465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 639/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:41.024406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:41.084078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:41.128354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70d71-1465-40c5-a4a9-7e58b96cd468 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:41.160984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:41.161670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:41.161954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:41.162232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:41.163007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:41.163318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:41.164768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfee8e-db34-4a09-9809-cd22d3b7f5b4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:41.176387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 633/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:41.182784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:41.270623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:41.279372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be74664-c418-4c8c-a538-d66da35b7438 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:41.311920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a51c97-8c72-45fa-a05b-8bf0ca40a5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:41.312809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a51c97-8c72-45fa-a05b-8bf0ca40a5dd None admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:41.313095 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a51c97-8c72-45fa-a05b-8bf0ca40a5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:41.313371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a51c97-8c72-45fa-a05b-8bf0ca40a5dd None admin] PATH_INFO: `/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/005d2ffd11584aaca47ba71a8bc2811a/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:41.315293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a51c97-8c72-45fa-a05b-8bf0ca40a5dd None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d44c13b7bf42b1b3576f31a21650fb, user_id=005d2ffd11584aaca47ba71a8bc2811a, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:41.316751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a51c97-8c72-45fa-a05b-8bf0ca40a5dd None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:41.329631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 640/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 14 10:43:41 2022] PUT /identity/v3/projects/a0d44c13b7bf42b1b3576f31a21650fb/users/005d2ffd11584aaca47ba71a8bc2811a/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:43:43.304101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccb3f-57de-4f3a-ac02-df7fb05e0775 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:43.304737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccb3f-57de-4f3a-ac02-df7fb05e0775 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:43.304737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccb3f-57de-4f3a-ac02-df7fb05e0775 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:43.306009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 634/1274] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:43.310955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:43.311338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:43.311515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:43.328705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:43.329881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:43.393214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 641/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:43.415699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ccb3f-57de-4f3a-ac02-df7fb05e0775 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:43.517473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ccb3f-57de-4f3a-ac02-df7fb05e0775 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:43.534358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:43.550947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:43.551726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:43.552535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:43.552817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:43.562674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:43.570861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:43.572011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:43.573082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 635/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 14 10:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:43.578452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:43.666408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:43.685416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a7e04-5822-4a52-b1d8-125b7f5492b8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:43.717220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:43.717874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:43.718154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:43.718429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:43.719158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:43.719461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:43.720834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:43.729036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 642/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 14 10:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:43.734853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:43.835501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb94d-2b24-4981-8b90-f129459c860a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:43.867818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:43.868629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:43.868910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:43.869182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:43.879762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:43.881233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:43.897706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:43.898781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:43.899726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:43.899726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:43.899726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:43.899726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:43.899726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 636/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:43.904545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:44.000183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf9e12-3384-4cf9-a59a-7274acdc2076 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:44.031556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:44.032225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:44.032505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:44.032776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:44.033482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:44.033784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:44.035135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:44.047092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 643/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:44.052633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:44.082499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:44.148817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d658-bb79-44c9-9861-9588387c92ca None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:44.180611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:44.181388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:44.181667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:44.181941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:44.189060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:44.190475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:44.204565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:44.205696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:44.207042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 637/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:44.211823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:44.215514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:44.306566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fa3bd-75cc-4a20-9f35-7c875bee3e53 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:44.338767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:44.339415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:44.339692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:44.339965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:44.340813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:44.341118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:44.342506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:44.359304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 644/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:44.365738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:44.452014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:44.461655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644142a-4601-4199-a330-28bf3d364d72 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:44.494075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:44.494700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:44.494978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:44.495246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:44.558861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:44.560303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:44.646808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:44.658745 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 638/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 14 10:43:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:43:44.664989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:44.723533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:44.760425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fac17-3969-4334-a954-6387d35d9875 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:44.793217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:44.793980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:44.794259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:44.794532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:44.804201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:44.805617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:44.822305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:44.823278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:44.824588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:44.824588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:44.824588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:44.824588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:44.824588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 645/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:44.829282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:44.925395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402306c-c351-43e7-9e94-9118a7103a54 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:44.957796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:44.958945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:44.959231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:44.959503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:44.960323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:44.960645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:44.961996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:44.972845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 639/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:44.978942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:45.073638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78397d-7c3a-45dd-902a-ac93fb1a7634 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:45.087610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:45.107185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:45.107967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:45.108282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:45.108564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:45.115016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:45.116492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:45.129885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:45.131469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: ERROR keystone.server.flask.application Jul 14 10:43:45.132589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 646/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:45.137205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:45.185568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:45.234517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f530-6289-45c8-aafa-73e3b0d17eae None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:45.266839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:45.267515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:45.267801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:45.268101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:45.268876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:45.269187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:45.270597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246922c0-af2f-46d7-8159-ec419ffe30d1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:45.282274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 640/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:45.288649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:45.385785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac60ad-2b40-421b-b95c-ba58070293f9 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:45.418301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:45.418938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:45.419224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:45.419501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:45.420343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] RBAC: Adding query filter params (role.id=195f05d542f14d7b93230878b428d9eb, scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb, user.id=005d2ffd11584aaca47ba71a8bc2811a) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:45.420658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:45.422083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4025281-3599-456b-9ecb-ffc9a3bb8c07 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:45.428403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 647/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 14 10:43:45 2022] GET /identity/v3/role_assignments?user.id=005d2ffd11584aaca47ba71a8bc2811a&scope.project.id=a0d44c13b7bf42b1b3576f31a21650fb&role.id=195f05d542f14d7b93230878b428d9eb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:47.454415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e556766-ee92-4740-aa54-34b016fe606e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:47.454962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e556766-ee92-4740-aa54-34b016fe606e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:47.454962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e556766-ee92-4740-aa54-34b016fe606e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:47.456372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 641/1288] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:47.461431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:47.461819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:47.461987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:47.478893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:47.480109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:47.508830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:47.544966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 648/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:47.567222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e556766-ee92-4740-aa54-34b016fe606e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:47.672431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e556766-ee92-4740-aa54-34b016fe606e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:47.685407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:47.710933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:47.711666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:47.711948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:47.712256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:47.712911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:47.714274 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:47.726582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:47.727781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:47.729054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 642/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:43:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:47.733715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:47.827565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc347c9-5633-445b-a57b-45ca340d1af1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:47.860391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:47.861045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:47.861327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:47.861603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:47.862303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:47.862611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:47.863969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d554a6-2dff-4b35-83a2-573b57226b25 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:47.868907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 649/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:47.874518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:47.970927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2417-8b78-423e-9210-7b2b8be22285 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:48.003225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:48.003868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:48.004248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:48.004526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:48.005223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:48.005529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:48.006912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790466f-2999-48c6-8950-f8da0547e8d2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:48.011249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 643/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:50.029362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe46f75-2d15-4afd-add3-be8c88f5e7b7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:50.029876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe46f75-2d15-4afd-add3-be8c88f5e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:50.029984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe46f75-2d15-4afd-add3-be8c88f5e7b7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:50.031254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 650/1293] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:50.036292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb8c2-67af-4cef-843d-b2ff46688f68 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:50.036736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb8c2-67af-4cef-843d-b2ff46688f68 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:50.036843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb8c2-67af-4cef-843d-b2ff46688f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:50.053662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-eb3cb8c2-67af-4cef-843d-b2ff46688f68 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:50.054836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eb3cb8c2-67af-4cef-843d-b2ff46688f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:50.083970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:50.121081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 644/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:50.144024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe46f75-2d15-4afd-add3-be8c88f5e7b7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:50.173706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:50.244526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe46f75-2d15-4afd-add3-be8c88f5e7b7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:50.276973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a5420-0119-43e2-a4a9-4e3b2cb2c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:50.277636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a5420-0119-43e2-a4a9-4e3b2cb2c5c7 None admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:50.277916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a5420-0119-43e2-a4a9-4e3b2cb2c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:50.278193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a5420-0119-43e2-a4a9-4e3b2cb2c5c7 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:50.278919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a5420-0119-43e2-a4a9-4e3b2cb2c5c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:50.280303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a5420-0119-43e2-a4a9-4e3b2cb2c5c7 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:50.292955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 651/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 14 10:43:50 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:43:52.294853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b5a22-145f-43ca-ab14-5defa54b510e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:52.295401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b5a22-145f-43ca-ab14-5defa54b510e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:52.295401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b5a22-145f-43ca-ab14-5defa54b510e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:52.296811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 645/1296] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:52.302434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:52.302871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:52.302980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:52.319942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:52.321159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:52.391041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 652/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:52.413442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b5a22-145f-43ca-ab14-5defa54b510e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:52.511656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b5a22-145f-43ca-ab14-5defa54b510e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:52.543860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:52.544676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:52.545008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:52.545262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:52.545912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:52.547267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:52.559371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:52.560538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:52.561591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 646/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:43:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:52.566510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:52.584982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:52.670563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844f6b9-9fe9-4ea0-9930-6df2e7039d02 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:52.709474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:52.710160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:52.710490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:52.710877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:52.711703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:52.712090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:52.713610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:52.718820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 653/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:52.725310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:52.756116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:52.822518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d1358-44f9-471e-8ba6-d605adfb864e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:52.855129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:52.855777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:52.856086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:52.856368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:52.857157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] RBAC: Adding query filter params (interface=public, service_id=a1f883d4ce7443ba80406e8be146b09f, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:52.857473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:52.858827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dabf5b-68c5-4604-a3bb-2419a236696f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:52.863946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 647/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 14 10:43:52 2022] GET /identity/v3/endpoints?service_id=a1f883d4ce7443ba80406e8be146b09f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:52.870155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:52.949421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:52.967669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26eaae-a8f2-4fe8-bc8a-19e1d6d52c18 None admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:53.000150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50dbc5-e918-4e26-8394-9d09139d2db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:53.000802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50dbc5-e918-4e26-8394-9d09139d2db3 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:53.001086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50dbc5-e918-4e26-8394-9d09139d2db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:53.001364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50dbc5-e918-4e26-8394-9d09139d2db3 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:53.002046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50dbc5-e918-4e26-8394-9d09139d2db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:53.003408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50dbc5-e918-4e26-8394-9d09139d2db3 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:53.010035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 654/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 14 10:43:52 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:43:54.995053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dfa5a-2318-41b7-8ea7-5db09d453077 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:54.995547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dfa5a-2318-41b7-8ea7-5db09d453077 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:54.995666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dfa5a-2318-41b7-8ea7-5db09d453077 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:54.996996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 648/1302] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:55.001895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:55.002278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:55.002441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:55.019037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:55.020235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:55.083199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 655/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:55.105757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dfa5a-2318-41b7-8ea7-5db09d453077 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:55.199018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:55.206224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dfa5a-2318-41b7-8ea7-5db09d453077 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:55.239735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:55.240546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:55.240832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:55.241111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:55.241753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:55.243100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:55.254759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:55.255951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Jul 14 10:43:55.257038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 649/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 14 10:43:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:55.261768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:55.334035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:55.356109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ab76f-a7af-42c8-a999-076d396ee5e9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:55.387276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:55.387917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:55.388233 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:55.388513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] PATH_INFO: `/v3/services` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:55.389206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:55.389509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:55.390843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ee41f-0ea6-4444-846e-6e65bfca8f05 None admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:55.396327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 656/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:55.401784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:55.498748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f492d50-aedd-4e55-a7f9-402888e418e6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:55.531022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8113f-6b3f-4226-b64a-d60f4dc88455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:55.531659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8113f-6b3f-4226-b64a-d60f4dc88455 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:55.531946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8113f-6b3f-4226-b64a-d60f4dc88455 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:55.532255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8113f-6b3f-4226-b64a-d60f4dc88455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:55.532989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8113f-6b3f-4226-b64a-d60f4dc88455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:55.534336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8113f-6b3f-4226-b64a-d60f4dc88455 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:55.552275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 650/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 14 10:43:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:44:05.392936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=30 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:05.547837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:58.023477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0344-8fba-4932-aeda-a72066642e80 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:58.024049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0344-8fba-4932-aeda-a72066642e80 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:58.024049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0344-8fba-4932-aeda-a72066642e80 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:58.030362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400249d-431e-45ba-ae8e-8976bfd9dec9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:58.030785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400249d-431e-45ba-ae8e-8976bfd9dec9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:58.030898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400249d-431e-45ba-ae8e-8976bfd9dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:58.034259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 657/1307] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:44:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:58.105174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0400249d-431e-45ba-ae8e-8976bfd9dec9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:58.106381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0400249d-431e-45ba-ae8e-8976bfd9dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:58.217969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 651/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:44:58.276892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425159cb-d180-4ebe-a82e-742885ffd4f7 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:58.277170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425159cb-d180-4ebe-a82e-742885ffd4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:58.277444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425159cb-d180-4ebe-a82e-742885ffd4f7 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:58.279056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 658/1309] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 14 10:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:58.286060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000977d-989a-405d-85eb-9624538dffc6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:58.286265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000977d-989a-405d-85eb-9624538dffc6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:58.286536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000977d-989a-405d-85eb-9624538dffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:58.384107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7000977d-989a-405d-85eb-9624538dffc6 None None] MFA Rules not processed for user `1f86dd9b76ef42e8a6fbff301df7d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:58.385590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7000977d-989a-405d-85eb-9624538dffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:58.410258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:58.484858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 652/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 14 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:58.494435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425159cb-d180-4ebe-a82e-742885ffd4f7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:58.496428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-425159cb-d180-4ebe-a82e-742885ffd4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:58.619219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425159cb-d180-4ebe-a82e-742885ffd4f7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:58.700318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:58.700962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:58.701242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:58.701515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:58.703132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:58.759286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:58.816476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:58.817901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5939-dc83-463a-acd7-d1745f49b10b service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:58.837418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 659/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:01.213014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157a33-f9c4-46fe-aace-3f1e1b7ed8a1 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:01.213537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157a33-f9c4-46fe-aace-3f1e1b7ed8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:01.213635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157a33-f9c4-46fe-aace-3f1e1b7ed8a1 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:01.216245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 653/1312] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:01.220320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb5be-581d-45d6-b7e0-00bb633317c2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:01.221187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb5be-581d-45d6-b7e0-00bb633317c2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:01.221666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb5be-581d-45d6-b7e0-00bb633317c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:01.316717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-714fb5be-581d-45d6-b7e0-00bb633317c2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:01.317960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-714fb5be-581d-45d6-b7e0-00bb633317c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:01.464640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 660/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:01.503809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157a33-f9c4-46fe-aace-3f1e1b7ed8a1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:01.505404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-80157a33-f9c4-46fe-aace-3f1e1b7ed8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:01.636802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157a33-f9c4-46fe-aace-3f1e1b7ed8a1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:01.718788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:01.722350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:01.723174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:01.723510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:01.724131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:01.725797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:01.835515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:01.836975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b757-cadd-4cde-9bfb-225992dc8158 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:01.857624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 654/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:04.148543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0afd8a-9511-4e5e-88ed-34c8c986cec9 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:04.149060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0afd8a-9511-4e5e-88ed-34c8c986cec9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:04.149060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0afd8a-9511-4e5e-88ed-34c8c986cec9 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:04.150394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 661/1315] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:04.155497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e8a3-8a36-42b6-b4df-35302f6bdb4a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:04.155917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e8a3-8a36-42b6-b4df-35302f6bdb4a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:04.156076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e8a3-8a36-42b6-b4df-35302f6bdb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:04.219510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-59c7e8a3-8a36-42b6-b4df-35302f6bdb4a None None] MFA Rules not processed for user `06de9042d4e14337bcd1d47f0275b9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:04.220732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-59c7e8a3-8a36-42b6-b4df-35302f6bdb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:04.271453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:04.316613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 655/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:04.356626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0afd8a-9511-4e5e-88ed-34c8c986cec9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:04.358221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-da0afd8a-9511-4e5e-88ed-34c8c986cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:04.367849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:04.460456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0afd8a-9511-4e5e-88ed-34c8c986cec9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:04.532961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:04.533603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:04.533888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:04.534751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:04.536500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:04.596026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:04.643101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:04.645172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2058e-c249-4b80-91e6-77f6e70ca363 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:04.663062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 662/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:07.192633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db091c2a-b326-4ee7-9d57-b23ab0f4fbe5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:07.193148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db091c2a-b326-4ee7-9d57-b23ab0f4fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:07.193269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db091c2a-b326-4ee7-9d57-b23ab0f4fbe5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:07.194552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 656/1318] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:07.199934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9fb7e-32da-48bc-a86d-314f15afa2a6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:07.200361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9fb7e-32da-48bc-a86d-314f15afa2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:07.200524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9fb7e-32da-48bc-a86d-314f15afa2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:07.262564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-06b9fb7e-32da-48bc-a86d-314f15afa2a6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:07.263742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-06b9fb7e-32da-48bc-a86d-314f15afa2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:07.356407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 663/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:07.395107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db091c2a-b326-4ee7-9d57-b23ab0f4fbe5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:07.396650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db091c2a-b326-4ee7-9d57-b23ab0f4fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:07.495502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db091c2a-b326-4ee7-9d57-b23ab0f4fbe5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:07.565049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:07.566207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:07.566484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:07.566756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:07.568391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:07.575860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:07.678965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:07.680444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b170b-0310-4051-81c4-cd3d15649ed2 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:07.698580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 657/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:45:10.380301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cede8b1-7e15-40ad-b1cb-b39b9e9e01f5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:10.380823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cede8b1-7e15-40ad-b1cb-b39b9e9e01f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:10.380943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cede8b1-7e15-40ad-b1cb-b39b9e9e01f5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:10.382228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 664/1321] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:10.387528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ea1fc-b9f9-4809-8577-cd4fac1e0d3a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:10.387970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ea1fc-b9f9-4809-8577-cd4fac1e0d3a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:10.388101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ea1fc-b9f9-4809-8577-cd4fac1e0d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:10.454236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-df2ea1fc-b9f9-4809-8577-cd4fac1e0d3a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:10.455450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df2ea1fc-b9f9-4809-8577-cd4fac1e0d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:10.515948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:10.562836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 658/1322] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:10.600805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cede8b1-7e15-40ad-b1cb-b39b9e9e01f5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:10.602420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5cede8b1-7e15-40ad-b1cb-b39b9e9e01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:10.623077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:10.713908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cede8b1-7e15-40ad-b1cb-b39b9e9e01f5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:10.794193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:10.794844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:10.795126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:10.795403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:10.797088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:10.870229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:10.909648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:10.911048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8796dbe-83d5-4939-81bb-874d6fa528e4 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:10.930292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 665/1323] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:13.024570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87c084-fe90-47ba-8509-a7f90a184ae6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:13.025094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87c084-fe90-47ba-8509-a7f90a184ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:13.025094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87c084-fe90-47ba-8509-a7f90a184ae6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:13.026418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 659/1324] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:13.031817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89071c-c046-4f74-aac3-71755dc0fa3b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:13.032249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89071c-c046-4f74-aac3-71755dc0fa3b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:13.032582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89071c-c046-4f74-aac3-71755dc0fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:13.108999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9a89071c-c046-4f74-aac3-71755dc0fa3b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:13.110230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9a89071c-c046-4f74-aac3-71755dc0fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:13.205301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 666/1325] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:13.241650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87c084-fe90-47ba-8509-a7f90a184ae6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:13.243205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6a87c084-fe90-47ba-8509-a7f90a184ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:13.346777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87c084-fe90-47ba-8509-a7f90a184ae6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:13.425590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:13.426247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:13.426531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:13.426810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:13.428491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:13.449692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:13.547131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:13.548448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c553f9-b381-45f0-99d5-f136246f6cba service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:13.569738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 660/1326] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:15.670510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941859-6f11-4de0-8f4d-72412254c9cd None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:15.671065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941859-6f11-4de0-8f4d-72412254c9cd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:15.671065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941859-6f11-4de0-8f4d-72412254c9cd None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:15.672402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 667/1327] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:15.677700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe374f3b-e612-47ae-8392-c8b19932df10 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:15.678159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe374f3b-e612-47ae-8392-c8b19932df10 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:15.678255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe374f3b-e612-47ae-8392-c8b19932df10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:15.744262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fe374f3b-e612-47ae-8392-c8b19932df10 None None] MFA Rules not processed for user `06de9042d4e14337bcd1d47f0275b9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:15.745501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe374f3b-e612-47ae-8392-c8b19932df10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:15.813546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:15.850210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 661/1328] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:15.899949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3435-fa58-487d-8e5b-33cc1d9ffe6e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:15.900271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3435-fa58-487d-8e5b-33cc1d9ffe6e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:15.900556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3435-fa58-487d-8e5b-33cc1d9ffe6e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:15.901943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 668/1329] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 14 10:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:15.907672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a2de-e5c2-4b9f-8fbd-5731db6e4881 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:15.908037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a2de-e5c2-4b9f-8fbd-5731db6e4881 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:15.908417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a2de-e5c2-4b9f-8fbd-5731db6e4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:15.984990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a8c8a2de-e5c2-4b9f-8fbd-5731db6e4881 None None] MFA Rules not processed for user `1f86dd9b76ef42e8a6fbff301df7d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:15.986299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8c8a2de-e5c2-4b9f-8fbd-5731db6e4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:16.061807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 662/1330] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 14 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:16.071343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3435-fa58-487d-8e5b-33cc1d9ffe6e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:16.072909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f6e3435-fa58-487d-8e5b-33cc1d9ffe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:16.103479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:16.195513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3435-fa58-487d-8e5b-33cc1d9ffe6e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:16.273751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:16.274427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:16.274706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:16.274979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:16.276643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:16.353874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:16.386204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:16.387578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b912bb-9803-4dd9-80e2-a923562e806b service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:16.405951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 669/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:19.083183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eac329-c3a4-4fd2-96af-9809c3b61a69 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:19.083776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eac329-c3a4-4fd2-96af-9809c3b61a69 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:19.083776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eac329-c3a4-4fd2-96af-9809c3b61a69 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:19.085140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 663/1332] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:19.090249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91546-dcb4-474a-9fde-f6ea43ec271b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:19.090640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91546-dcb4-474a-9fde-f6ea43ec271b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:19.090811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91546-dcb4-474a-9fde-f6ea43ec271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:19.155727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4bf91546-dcb4-474a-9fde-f6ea43ec271b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:19.156991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4bf91546-dcb4-474a-9fde-f6ea43ec271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:19.253263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 670/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:19.288833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eac329-c3a4-4fd2-96af-9809c3b61a69 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:19.290366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f9eac329-c3a4-4fd2-96af-9809c3b61a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:19.358270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:19.392550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eac329-c3a4-4fd2-96af-9809c3b61a69 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:19.462976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:19.463539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:19.463821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:19.464116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:19.465728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:19.572032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:19.573479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca5b7-6725-4ab5-8fb6-4af37388078c service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:19.583616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:19.591952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 664/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:21.653312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4c22d-0c1f-41e8-a3d4-2faa862fb5b2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:21.653890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4c22d-0c1f-41e8-a3d4-2faa862fb5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:21.653890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4c22d-0c1f-41e8-a3d4-2faa862fb5b2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:21.655229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 671/1335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:21.660436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b289b-9299-438d-ae03-9fbc13366331 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:21.660840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b289b-9299-438d-ae03-9fbc13366331 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:21.661035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b289b-9299-438d-ae03-9fbc13366331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:21.726397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9b4b289b-9299-438d-ae03-9fbc13366331 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:21.727578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9b4b289b-9299-438d-ae03-9fbc13366331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:21.829419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 665/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:21.869494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4c22d-0c1f-41e8-a3d4-2faa862fb5b2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:21.871038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-15f4c22d-0c1f-41e8-a3d4-2faa862fb5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:21.911093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:21.974796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4c22d-0c1f-41e8-a3d4-2faa862fb5b2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:22.045125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:22.045763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:22.046076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:22.046352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:22.047980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:22.128244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:22.154825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:22.156282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b835e5-7751-4f97-8a8b-6b9fdc9dd5ee service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:22.175344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 672/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:24.491633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aeb30-0411-4eb6-917b-d91db0233f58 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:24.492227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aeb30-0411-4eb6-917b-d91db0233f58 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:24.492227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aeb30-0411-4eb6-917b-d91db0233f58 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:24.493597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 666/1338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:24.498772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded7f0-1b65-4bfa-9e66-b649db4e5653 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:24.499149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded7f0-1b65-4bfa-9e66-b649db4e5653 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:24.499353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded7f0-1b65-4bfa-9e66-b649db4e5653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:24.562310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-04ded7f0-1b65-4bfa-9e66-b649db4e5653 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:24.563527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-04ded7f0-1b65-4bfa-9e66-b649db4e5653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:24.657354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 673/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:24.692881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aeb30-0411-4eb6-917b-d91db0233f58 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:24.694400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-345aeb30-0411-4eb6-917b-d91db0233f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:24.768934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:24.796016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aeb30-0411-4eb6-917b-d91db0233f58 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:24.868597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:24.869248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:24.869532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:24.869840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:24.871487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:24.987514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:24.988973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63bb68-7143-4874-8181-df912963ae4f service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:25.007858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 667/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:29.099575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58a20-b4e3-407b-bbdc-9c0788839684 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:29.100131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58a20-b4e3-407b-bbdc-9c0788839684 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:29.100131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58a20-b4e3-407b-bbdc-9c0788839684 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:29.101454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 674/1341] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:29.106624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c25c5-f459-48c3-ba33-1665e8405e30 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:29.107046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c25c5-f459-48c3-ba33-1665e8405e30 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:29.107192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c25c5-f459-48c3-ba33-1665e8405e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:29.111392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:29.176854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a36c25c5-f459-48c3-ba33-1665e8405e30 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:29.178049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a36c25c5-f459-48c3-ba33-1665e8405e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:29.277582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 668/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:29.316292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58a20-b4e3-407b-bbdc-9c0788839684 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:29.317887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6a58a20-b4e3-407b-bbdc-9c0788839684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:29.366241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:29.420820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58a20-b4e3-407b-bbdc-9c0788839684 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:29.495046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:29.495692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:29.495970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:29.496271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:29.497903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:29.591734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:29.608723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:29.610171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c330f8-5fcd-4970-b9d5-c12528394196 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:29.629354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 675/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:32.258498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44690-4b7c-4cf4-b470-1db5231c6ad4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:32.259052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44690-4b7c-4cf4-b470-1db5231c6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:32.259052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44690-4b7c-4cf4-b470-1db5231c6ad4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:32.260522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 669/1344] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:32.266540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694c250-8c54-4793-99ce-c046f2378fbb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:32.267041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694c250-8c54-4793-99ce-c046f2378fbb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:32.267133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694c250-8c54-4793-99ce-c046f2378fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:32.338197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3694c250-8c54-4793-99ce-c046f2378fbb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:32.339443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3694c250-8c54-4793-99ce-c046f2378fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:32.437516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 676/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:32.474827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44690-4b7c-4cf4-b470-1db5231c6ad4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:32.476430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9cf44690-4b7c-4cf4-b470-1db5231c6ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:32.566365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:32.584035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44690-4b7c-4cf4-b470-1db5231c6ad4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:32.660119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:32.660780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:32.661062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:32.661342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:32.663043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:32.772344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:32.773781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879001b-39eb-4b90-b1d8-202836deb22b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:32.792385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 670/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:36.727913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285838e9-b473-47f5-b2d9-f691101df287 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:36.728470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285838e9-b473-47f5-b2d9-f691101df287 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:36.728565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285838e9-b473-47f5-b2d9-f691101df287 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:36.729893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 677/1347] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:36.735118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b6fb-a0f7-425d-b3e1-de9f8fed4719 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:36.735568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b6fb-a0f7-425d-b3e1-de9f8fed4719 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:36.735663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b6fb-a0f7-425d-b3e1-de9f8fed4719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:36.750072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:36.805503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c150b6fb-a0f7-425d-b3e1-de9f8fed4719 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:36.806763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c150b6fb-a0f7-425d-b3e1-de9f8fed4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:36.940135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 671/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:36.980652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285838e9-b473-47f5-b2d9-f691101df287 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:36.982183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-285838e9-b473-47f5-b2d9-f691101df287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:37.042242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:37.090830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285838e9-b473-47f5-b2d9-f691101df287 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:37.167453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:37.168154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:37.168442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:37.168718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:37.170420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:37.282467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:37.286273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:37.288682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37681d9e-0e01-4f42-aa87-047375da50c4 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:37.309033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 678/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:42.213724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe864-a84c-4417-ba45-899aa780e09d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:42.214233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe864-a84c-4417-ba45-899aa780e09d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:42.214347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe864-a84c-4417-ba45-899aa780e09d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:42.220346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 672/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:42.221990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dc883-24e9-48eb-8a57-6f5ec13d8bd7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:42.222825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dc883-24e9-48eb-8a57-6f5ec13d8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:42.223243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dc883-24e9-48eb-8a57-6f5ec13d8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:42.306507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2d8dc883-24e9-48eb-8a57-6f5ec13d8bd7 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:42.307880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2d8dc883-24e9-48eb-8a57-6f5ec13d8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:42.424936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 679/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:45:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:46.524048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1798ce-f0bd-4580-8811-073772a1d997 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:46.525018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1798ce-f0bd-4580-8811-073772a1d997 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:46.525500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1798ce-f0bd-4580-8811-073772a1d997 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:46.527372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 673/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:46.532972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224814-85f7-4383-9177-b5a91d0ee675 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:46.533953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224814-85f7-4383-9177-b5a91d0ee675 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:46.535014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224814-85f7-4383-9177-b5a91d0ee675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:46.590131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:46.614177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ad224814-85f7-4383-9177-b5a91d0ee675 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:46.615388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad224814-85f7-4383-9177-b5a91d0ee675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:46.728101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 680/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:46.936484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=59 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:48.107947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fbca-9ac0-49f1-8e7e-632bd7d979ce None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:48.108591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fbca-9ac0-49f1-8e7e-632bd7d979ce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:48.108591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fbca-9ac0-49f1-8e7e-632bd7d979ce None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:48.109868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 674/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:48.115253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0829d6-d63c-4e3f-bf8f-efa89007ae54 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:48.115646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0829d6-d63c-4e3f-bf8f-efa89007ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:48.115837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0829d6-d63c-4e3f-bf8f-efa89007ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:48.190754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fb0829d6-d63c-4e3f-bf8f-efa89007ae54 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:48.191983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fb0829d6-d63c-4e3f-bf8f-efa89007ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:48.236142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:48.303753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 681/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:45:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:51.698810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff320-199b-4dec-8934-55f3d2bd2a61 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:51.699616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff320-199b-4dec-8934-55f3d2bd2a61 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:51.699616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff320-199b-4dec-8934-55f3d2bd2a61 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:51.702227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 675/1356] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:51.709550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462c38-2ce3-4448-a64e-ab5372781d1c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:51.710447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462c38-2ce3-4448-a64e-ab5372781d1c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:51.710937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462c38-2ce3-4448-a64e-ab5372781d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:51.787392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bd462c38-2ce3-4448-a64e-ab5372781d1c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:51.788890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bd462c38-2ce3-4448-a64e-ab5372781d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:51.900242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 682/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:51.954002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16aa37-f428-4d20-a8ca-cb98d3aa7340 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:51.954383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16aa37-f428-4d20-a8ca-cb98d3aa7340 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:51.954566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16aa37-f428-4d20-a8ca-cb98d3aa7340 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:51.956153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 676/1358] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 14 10:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:51.964559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7cdc8-10c8-469e-9a02-e1fb22c87c43 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:51.966171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7cdc8-10c8-469e-9a02-e1fb22c87c43 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:51.966707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7cdc8-10c8-469e-9a02-e1fb22c87c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:51.986836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:52.058713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e0c7cdc8-10c8-469e-9a02-e1fb22c87c43 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:52.060013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e0c7cdc8-10c8-469e-9a02-e1fb22c87c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:52.186698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 683/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 14 10:45:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:52.194636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16aa37-f428-4d20-a8ca-cb98d3aa7340 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:52.196439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca16aa37-f428-4d20-a8ca-cb98d3aa7340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:52.352602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16aa37-f428-4d20-a8ca-cb98d3aa7340 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:52.428223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:52.472128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:52.472963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:52.473349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:52.473728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:52.475474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:52.569848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:52.571452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfe81f-7713-4fc8-af71-e58d1da1f8f0 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:52.591482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 677/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:54.850287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8f4d7-1483-4722-a326-a22d06a0d93d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:54.850783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8f4d7-1483-4722-a326-a22d06a0d93d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:54.850937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8f4d7-1483-4722-a326-a22d06a0d93d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:54.857815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038a6e-4a64-42a7-93e7-558f71307e71 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:54.858273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038a6e-4a64-42a7-93e7-558f71307e71 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:54.858439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038a6e-4a64-42a7-93e7-558f71307e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:54.863169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 684/1361] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:54.932727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6f038a6e-4a64-42a7-93e7-558f71307e71 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:54.933935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6f038a6e-4a64-42a7-93e7-558f71307e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:54.975229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:55.050378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 678/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:55.096360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8f4d7-1483-4722-a326-a22d06a0d93d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:55.097816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-95c8f4d7-1483-4722-a326-a22d06a0d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:55.174312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:55.277240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8f4d7-1483-4722-a326-a22d06a0d93d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:55.408939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:55.409636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:55.409848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:55.410122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:55.411740 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:55.435837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:55.506963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:55.508817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9d224-3ac1-445f-a2fc-be4936d3e235 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:55.528913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 685/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:57.894409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddbbaa-a229-4f41-87dd-850a3b2265c4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:57.894908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddbbaa-a229-4f41-87dd-850a3b2265c4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:57.895003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddbbaa-a229-4f41-87dd-850a3b2265c4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:57.896383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 679/1364] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:57.901795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3349-eba5-4a63-b945-69e996b54261 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:57.902571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3349-eba5-4a63-b945-69e996b54261 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:57.902867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3349-eba5-4a63-b945-69e996b54261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:57.979556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a0bf3349-eba5-4a63-b945-69e996b54261 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:57.981021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a0bf3349-eba5-4a63-b945-69e996b54261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:58.089152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:58.098565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 686/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:58.138377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345307-0c7a-49d3-be0a-e71722e80d66 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:58.138883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345307-0c7a-49d3-be0a-e71722e80d66 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:58.139272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345307-0c7a-49d3-be0a-e71722e80d66 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:58.141239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 680/1366] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 14 10:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:58.146125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba06592-a028-4611-9236-637514ce0df1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:58.146416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba06592-a028-4611-9236-637514ce0df1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:58.146698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba06592-a028-4611-9236-637514ce0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:58.226178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8ba06592-a028-4611-9236-637514ce0df1 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:58.227384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8ba06592-a028-4611-9236-637514ce0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:58.353648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 687/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 14 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:58.361202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56345307-0c7a-49d3-be0a-e71722e80d66 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:58.362753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-56345307-0c7a-49d3-be0a-e71722e80d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:58.526987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56345307-0c7a-49d3-be0a-e71722e80d66 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:58.551066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:58.652602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:58.653178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:58.653460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:58.653736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:58.655398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:58.748810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:58.750433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849c654-573b-445a-8cd4-0f7fe6b43b07 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:58.770365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 681/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:59.809295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2a1c-4be5-435c-860b-36092f8ac5a2 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:59.809870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2a1c-4be5-435c-860b-36092f8ac5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:59.809870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2a1c-4be5-435c-860b-36092f8ac5a2 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:59.811417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 688/1369] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:59.816425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44517f-d8e9-4735-946d-cd85838f05fc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:59.816822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44517f-d8e9-4735-946d-cd85838f05fc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:59.816989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44517f-d8e9-4735-946d-cd85838f05fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:59.849858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:59.896755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4c44517f-d8e9-4735-946d-cd85838f05fc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:59.898102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c44517f-d8e9-4735-946d-cd85838f05fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:00.003121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 682/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:00.350492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df3e8f-de5c-4324-af78-cb9d9323788d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:00.351210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df3e8f-de5c-4324-af78-cb9d9323788d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:00.351592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df3e8f-de5c-4324-af78-cb9d9323788d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:00.353288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 689/1371] 10.222.0.64 () {54 vars in 963 bytes} [Thu Jul 14 10:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:00.358484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cfe6c-40c2-45ed-b3ee-32280c09277b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:00.358771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cfe6c-40c2-45ed-b3ee-32280c09277b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:00.359045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cfe6c-40c2-45ed-b3ee-32280c09277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:00.443554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ef7cfe6c-40c2-45ed-b3ee-32280c09277b None None] MFA Rules not processed for user `b7de00325c784e79be24c9928dd535e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:00.444951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ef7cfe6c-40c2-45ed-b3ee-32280c09277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:00.495897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:00.530384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 683/1372] 10.222.0.64 () {58 vars in 1060 bytes} [Thu Jul 14 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:00.538850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df3e8f-de5c-4324-af78-cb9d9323788d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:00.540378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d6df3e8f-de5c-4324-af78-cb9d9323788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:00.594485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:00.650801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df3e8f-de5c-4324-af78-cb9d9323788d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:00.727044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:00.727760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:00.728176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:00.728548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:00.730276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:00.835418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:00.852155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:00.853985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37efd8d-c8f0-4dce-904f-c642a5ce5146 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:00.880201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 690/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:00.887384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266737-62b7-4708-b534-b388b66edc73 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:00.887790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266737-62b7-4708-b534-b388b66edc73 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:00.887953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2266737-62b7-4708-b534-b388b66edc73 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:00.889228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 684/1374] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:46:00.895078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05db3b-64f6-4014-8be5-71784f634a33 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:00.895261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05db3b-64f6-4014-8be5-71784f634a33 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:00.895549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05db3b-64f6-4014-8be5-71784f634a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:00.959267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2e05db3b-64f6-4014-8be5-71784f634a33 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:00.960516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2e05db3b-64f6-4014-8be5-71784f634a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:01.064587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 691/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:01.105668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2266737-62b7-4708-b534-b388b66edc73 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:01.107150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d2266737-62b7-4708-b534-b388b66edc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:01.289596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2266737-62b7-4708-b534-b388b66edc73 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:01.340734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:01.401926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:01.402569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:01.402849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:01.403124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:01.404778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:01.492901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:01.494660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545ee0e-79c4-4eaa-9036-11a91b8f28cc service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:01.513064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 685/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:03.559372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec374-2d01-49b8-a7ce-d8a085a9a64d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:03.559860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec374-2d01-49b8-a7ce-d8a085a9a64d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:03.559860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec374-2d01-49b8-a7ce-d8a085a9a64d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:03.561257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 692/1377] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:03.566442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d66ab-f878-46f8-aade-c7707978cbda None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:03.566875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d66ab-f878-46f8-aade-c7707978cbda None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:03.567006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d66ab-f878-46f8-aade-c7707978cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:03.632205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0d9d66ab-f878-46f8-aade-c7707978cbda None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:03.633401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0d9d66ab-f878-46f8-aade-c7707978cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:03.640045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:03.734547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 686/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:03.777940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaec374-2d01-49b8-a7ce-d8a085a9a64d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:03.779537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fcaec374-2d01-49b8-a7ce-d8a085a9a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:03.845611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:03.959290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaec374-2d01-49b8-a7ce-d8a085a9a64d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:04.070932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:04.071611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:04.071893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:04.072200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:04.073833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:04.092231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:04.162976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:04.164609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb88c8-8d19-48ca-8e83-752b9d586154 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:04.184355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 693/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:06.259029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c5357-9390-4088-9c45-8f22f44fd69f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:06.259495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c5357-9390-4088-9c45-8f22f44fd69f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:06.259805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c5357-9390-4088-9c45-8f22f44fd69f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:06.261528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 687/1380] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:06.266488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366fec-dc5b-4ecd-9a6a-91451b269516 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:06.266925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366fec-dc5b-4ecd-9a6a-91451b269516 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:06.267273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366fec-dc5b-4ecd-9a6a-91451b269516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:06.337055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-68366fec-dc5b-4ecd-9a6a-91451b269516 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:06.338408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-68366fec-dc5b-4ecd-9a6a-91451b269516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:06.446739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:06.456785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 694/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:06.501823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c5357-9390-4088-9c45-8f22f44fd69f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:06.503355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b94c5357-9390-4088-9c45-8f22f44fd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:06.646284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:06.659717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c5357-9390-4088-9c45-8f22f44fd69f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:06.794131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:06.794944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:06.795270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:06.795613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:06.797717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:06.897992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:06.899572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e545ea-2388-4ea9-b64b-6572469518d3 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:06.911731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:06.921425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 688/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:09.026067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742173-b32b-441c-930a-2a0ab797eb6f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:09.026625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742173-b32b-441c-930a-2a0ab797eb6f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:09.026625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742173-b32b-441c-930a-2a0ab797eb6f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:09.027981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 695/1383] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:09.033932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53172ca-d821-4c5f-aa96-ca51404b30ba None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:09.034355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53172ca-d821-4c5f-aa96-ca51404b30ba None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:09.034492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53172ca-d821-4c5f-aa96-ca51404b30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:09.104540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f53172ca-d821-4c5f-aa96-ca51404b30ba None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:09.105840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f53172ca-d821-4c5f-aa96-ca51404b30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:09.216439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 689/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:09.260190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742173-b32b-441c-930a-2a0ab797eb6f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:09.261764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58742173-b32b-441c-930a-2a0ab797eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:09.410548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742173-b32b-441c-930a-2a0ab797eb6f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:09.478870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:09.525048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:09.525708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:09.525994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:09.526275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:09.527932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:09.619567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:09.621257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4db9-f293-4fb6-b8de-9be105f76f45 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:09.640013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 696/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:11.663229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d030a-cb4b-4a2f-b293-95787092fdf4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:11.663769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d030a-cb4b-4a2f-b293-95787092fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:11.664046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d030a-cb4b-4a2f-b293-95787092fdf4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:11.666250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 690/1386] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:11.671302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb907d-a25f-40ba-a40d-5cd222301ba6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:11.671706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb907d-a25f-40ba-a40d-5cd222301ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:11.671853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb907d-a25f-40ba-a40d-5cd222301ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:11.738249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-34fb907d-a25f-40ba-a40d-5cd222301ba6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:11.739517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-34fb907d-a25f-40ba-a40d-5cd222301ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:11.771901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:11.838593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 697/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:11.882920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d030a-cb4b-4a2f-b293-95787092fdf4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:11.884482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-405d030a-cb4b-4a2f-b293-95787092fdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:11.967437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:12.040782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d030a-cb4b-4a2f-b293-95787092fdf4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:12.161324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:12.162074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:12.162405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:12.162623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:12.164300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:12.202897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:12.260994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:12.262586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d3ada-99ae-4757-9760-10a48b3e8ca8 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:12.281269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 691/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:14.500861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b142fc-f806-425c-a4a4-a118b5c96026 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:14.501918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b142fc-f806-425c-a4a4-a118b5c96026 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:14.501918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b142fc-f806-425c-a4a4-a118b5c96026 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:14.503292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 698/1389] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:14.508519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1de6d-d436-4956-91e0-e41ace3c6779 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:14.508929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1de6d-d436-4956-91e0-e41ace3c6779 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:14.509195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1de6d-d436-4956-91e0-e41ace3c6779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:14.573927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4af1de6d-d436-4956-91e0-e41ace3c6779 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:14.575390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4af1de6d-d436-4956-91e0-e41ace3c6779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:14.672439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 692/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:14.716216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b142fc-f806-425c-a4a4-a118b5c96026 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:14.717747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-45b142fc-f806-425c-a4a4-a118b5c96026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:14.866045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b142fc-f806-425c-a4a4-a118b5c96026 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:14.883391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:14.978680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:14.979438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:14.979745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:14.980019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:14.981690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:15.069783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:15.071483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d29b-3849-4f12-bee8-fd75f0c25618 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:15.091485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 699/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:16.019231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93c0e5-1af7-498b-b2ec-cd6cc378f79d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:16.019807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93c0e5-1af7-498b-b2ec-cd6cc378f79d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:16.019807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93c0e5-1af7-498b-b2ec-cd6cc378f79d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:16.021218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 693/1392] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:16.026506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5eb35-54ad-4938-b36c-2d147d4eede7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:16.026905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5eb35-54ad-4938-b36c-2d147d4eede7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:16.027066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5eb35-54ad-4938-b36c-2d147d4eede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:16.050836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.093159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e0a5eb35-54ad-4938-b36c-2d147d4eede7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:16.094372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e0a5eb35-54ad-4938-b36c-2d147d4eede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.189135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 700/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:16.245942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755572b-581b-4cd8-a392-b7d0380d551b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:16.246226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755572b-581b-4cd8-a392-b7d0380d551b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:16.246501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755572b-581b-4cd8-a392-b7d0380d551b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:16.247858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 694/1394] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 14 10:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:16.253635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264949-ae9a-4992-b8dc-be7fcf4ce1f5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:16.253928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264949-ae9a-4992-b8dc-be7fcf4ce1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:16.254209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264949-ae9a-4992-b8dc-be7fcf4ce1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:16.444897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-07264949-ae9a-4992-b8dc-be7fcf4ce1f5 None None] MFA Rules not processed for user `eb4489f887f944f0806b63b669ffb883`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:16.446046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-07264949-ae9a-4992-b8dc-be7fcf4ce1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.487289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.523890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 701/1395] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 14 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:16.531481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755572b-581b-4cd8-a392-b7d0380d551b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:16.533079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a755572b-581b-4cd8-a392-b7d0380d551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.546740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.638264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755572b-581b-4cd8-a392-b7d0380d551b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:16.722952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:16.723957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:16.724270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:16.724605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:16.726203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.794303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.836529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:16.837983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042818cc-549d-4ff7-adb2-020746d2de64 service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:16.856351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 695/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:17.177871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9059c9a-b5fc-4a70-b06b-9af46c371931 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.178478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9059c9a-b5fc-4a70-b06b-9af46c371931 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.178589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9059c9a-b5fc-4a70-b06b-9af46c371931 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.179898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 702/1397] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:17.185492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d866-7c53-4b97-86bd-a5189c0bf20e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.185929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d866-7c53-4b97-86bd-a5189c0bf20e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.186041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d866-7c53-4b97-86bd-a5189c0bf20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.255941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6e55d866-7c53-4b97-86bd-a5189c0bf20e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:17.257111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6e55d866-7c53-4b97-86bd-a5189c0bf20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.355394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 696/1398] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:17.399363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9059c9a-b5fc-4a70-b06b-9af46c371931 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:17.400909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f9059c9a-b5fc-4a70-b06b-9af46c371931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.557315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9059c9a-b5fc-4a70-b06b-9af46c371931 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:17.581049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054280d-eb5d-4957-b02c-617c86283d6e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.581346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054280d-eb5d-4957-b02c-617c86283d6e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.581627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054280d-eb5d-4957-b02c-617c86283d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.606608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:17.608770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:17.649273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c054280d-eb5d-4957-b02c-617c86283d6e None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:17.650485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c054280d-eb5d-4957-b02c-617c86283d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.674888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:17.675533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.675809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.676102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.677701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.739276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 697/1399] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:46:17.770029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:17.771633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:17.781861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725bce-0771-4e5e-84b1-cabdf844672e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.782149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725bce-0771-4e5e-84b1-cabdf844672e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.782425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725bce-0771-4e5e-84b1-cabdf844672e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.783809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 698/1400] 10.222.0.64 () {54 vars in 942 bytes} [Thu Jul 14 10:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:46:17.790219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7db2e-d252-4be2-9c00-8f45e2a8534f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.790502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7db2e-d252-4be2-9c00-8f45e2a8534f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.790660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 703/1401] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:17.790774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7db2e-d252-4be2-9c00-8f45e2a8534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.873469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6fc7db2e-d252-4be2-9c00-8f45e2a8534f None None] MFA Rules not processed for user `eac24ebb573140718662633d85735b71`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:17.874767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6fc7db2e-d252-4be2-9c00-8f45e2a8534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.941055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:18.003295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 699/1402] 10.222.0.64 () {58 vars in 1039 bytes} [Thu Jul 14 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:46:18.012892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:18.014088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:18.070246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:18.104880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57866-2ada-46ac-b807-b838a28b51b5 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:18.210433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:18.211101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:18.211352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:18.211683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:18.213436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:18.295769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:18.297659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03709a-0627-4d63-92b0-d77b78fa1d73 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:18.302392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:18.306559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 704/1403] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 10:46:19.824418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfef5-55be-46c9-9283-137bfab48e35 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:19.825537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfef5-55be-46c9-9283-137bfab48e35 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:19.826087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfef5-55be-46c9-9283-137bfab48e35 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:19.827871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 700/1404] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:19.836129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2fca-33ea-43db-aba8-03aad3c28c9a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:19.836704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2fca-33ea-43db-aba8-03aad3c28c9a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:19.836790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2fca-33ea-43db-aba8-03aad3c28c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:19.916053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-37bf2fca-33ea-43db-aba8-03aad3c28c9a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:19.917565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-37bf2fca-33ea-43db-aba8-03aad3c28c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:20.023637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 705/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:20.069488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbfef5-55be-46c9-9283-137bfab48e35 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:20.071143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9cdbfef5-55be-46c9-9283-137bfab48e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:20.244673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbfef5-55be-46c9-9283-137bfab48e35 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:20.277658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:20.378451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:20.379210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:20.379497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:20.379777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:20.381711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:20.482821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:20.484472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65296ea-4161-405a-8d57-5bf863536580 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:20.504827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 701/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:22.633833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1ba8-59b5-4aaa-96d0-403aa918e675 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:22.634825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1ba8-59b5-4aaa-96d0-403aa918e675 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:22.635109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1ba8-59b5-4aaa-96d0-403aa918e675 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:22.636731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 706/1407] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:22.641875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eacd9-6005-48c5-b0b3-eb2f926c3aea None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:22.642316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eacd9-6005-48c5-b0b3-eb2f926c3aea None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:22.642496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eacd9-6005-48c5-b0b3-eb2f926c3aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:22.686046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:22.714574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c16eacd9-6005-48c5-b0b3-eb2f926c3aea None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:22.715819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c16eacd9-6005-48c5-b0b3-eb2f926c3aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:22.822397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 702/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:22.869021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae1ba8-59b5-4aaa-96d0-403aa918e675 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:22.870822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0eae1ba8-59b5-4aaa-96d0-403aa918e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:22.956698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:23.029953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae1ba8-59b5-4aaa-96d0-403aa918e675 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:23.154971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:23.155708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:23.156016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:23.156323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:23.158093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:23.204875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:23.264618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:23.266139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eb4c2-d679-4ddb-bc01-fef6c9a5b2b7 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:23.288832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 707/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:32.819315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=51 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:33.282597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=27 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:40.929572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88433-d6a1-4a2d-b95b-fbd601dd2b15 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:40.930153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88433-d6a1-4a2d-b95b-fbd601dd2b15 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:40.930153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88433-d6a1-4a2d-b95b-fbd601dd2b15 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:40.931510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 703/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 14 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:40.936711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423305a-a37c-46c3-b077-7a61aeb3f842 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:40.937107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423305a-a37c-46c3-b077-7a61aeb3f842 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:40.937269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423305a-a37c-46c3-b077-7a61aeb3f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:41.014776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c423305a-a37c-46c3-b077-7a61aeb3f842 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:41.016503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c423305a-a37c-46c3-b077-7a61aeb3f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:41.119010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 708/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 14 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:41.133321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7527e11-fe26-4153-ac40-5c250e93fad5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:41.133698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7527e11-fe26-4153-ac40-5c250e93fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:41.133979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7527e11-fe26-4153-ac40-5c250e93fad5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:41.135327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 704/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 14 10:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:41.139861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba20f92-9eb3-4c91-b102-018269d1bd9f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:41.140186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba20f92-9eb3-4c91-b102-018269d1bd9f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:41.140460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba20f92-9eb3-4c91-b102-018269d1bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:41.211088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:41.213973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6ba20f92-9eb3-4c91-b102-018269d1bd9f None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:41.215741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6ba20f92-9eb3-4c91-b102-018269d1bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:41.328838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 709/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 14 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:43.811501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad295cc-f201-48b8-93e6-352e868dbb6c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:43.811987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad295cc-f201-48b8-93e6-352e868dbb6c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:43.811987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad295cc-f201-48b8-93e6-352e868dbb6c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:43.813403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:43.818554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9f51-8989-4c44-9cfc-9906b911ba01 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:43.819003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9f51-8989-4c44-9cfc-9906b911ba01 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:43.819111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9f51-8989-4c44-9cfc-9906b911ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:43.884298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d8cf9f51-8989-4c44-9cfc-9906b911ba01 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:43.885567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d8cf9f51-8989-4c44-9cfc-9906b911ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:43.939718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:43.982335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:44.024300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad295cc-f201-48b8-93e6-352e868dbb6c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:44.025821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ad295cc-f201-48b8-93e6-352e868dbb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:44.167601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad295cc-f201-48b8-93e6-352e868dbb6c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:44.238697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:44.278697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:44.279344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:44.279632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:44.279911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:44.282168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:44.369668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:44.371265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ec00f-dad5-44e9-aec2-78ba9f8bcc60 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:44.389417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 706/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:45.276950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968f95-d8d8-4684-90a9-78af1fba7c35 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:45.277520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968f95-d8d8-4684-90a9-78af1fba7c35 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:45.277520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968f95-d8d8-4684-90a9-78af1fba7c35 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:45.278974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:45.284582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9208d-9875-462e-b9a1-cda319328beb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:45.285003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9208d-9875-462e-b9a1-cda319328beb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:45.285154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9208d-9875-462e-b9a1-cda319328beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:45.360387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0eb9208d-9875-462e-b9a1-cda319328beb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:45.361580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0eb9208d-9875-462e-b9a1-cda319328beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:45.387430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:45.456662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:45.605160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968f95-d8d8-4684-90a9-78af1fba7c35 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:45.606595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2968f95-d8d8-4684-90a9-78af1fba7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:45.750200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968f95-d8d8-4684-90a9-78af1fba7c35 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:45.789687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:45.862225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:45.862799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:45.863082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:45.863357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:45.865045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:45.955255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:45.956864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689b79c-3a8a-4cfa-99b6-0c4a9e4720c1 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:45.980423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 712/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:46.861870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543e5c5-06d0-4f3f-8997-616d5ba62fc4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:46.862405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543e5c5-06d0-4f3f-8997-616d5ba62fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:46.862405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543e5c5-06d0-4f3f-8997-616d5ba62fc4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:46.863896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:46.868940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c3e1-a2ee-4a14-8b4f-a3ea683396ca None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:46.869373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c3e1-a2ee-4a14-8b4f-a3ea683396ca None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:46.869480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c3e1-a2ee-4a14-8b4f-a3ea683396ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:46.921366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:46.942808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d8f2c3e1-a2ee-4a14-8b4f-a3ea683396ca None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:46.944008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d8f2c3e1-a2ee-4a14-8b4f-a3ea683396ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:47.037120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:47.186863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543e5c5-06d0-4f3f-8997-616d5ba62fc4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:47.188690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1543e5c5-06d0-4f3f-8997-616d5ba62fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:47.333587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543e5c5-06d0-4f3f-8997-616d5ba62fc4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:47.345619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:47.445071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:47.445640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:47.445920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:47.446188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:47.447803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:47.535127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:47.536758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaf498-44fe-4454-861a-0a3353853c46 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:47.554456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 709/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:48.404926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4038b-319c-43f6-97e2-90b22b954a2e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:48.405482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4038b-319c-43f6-97e2-90b22b954a2e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:48.405482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4038b-319c-43f6-97e2-90b22b954a2e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:48.406937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:48.411914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72bcf1-5508-45be-9ed0-663f7c9a4b8c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:48.412323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72bcf1-5508-45be-9ed0-663f7c9a4b8c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:48.412505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72bcf1-5508-45be-9ed0-663f7c9a4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:48.430980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:48.488365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4c72bcf1-5508-45be-9ed0-663f7c9a4b8c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:48.489585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c72bcf1-5508-45be-9ed0-663f7c9a4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:48.583639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:48.734184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4038b-319c-43f6-97e2-90b22b954a2e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:48.736202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eae4038b-319c-43f6-97e2-90b22b954a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:48.841987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:48.878129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4038b-319c-43f6-97e2-90b22b954a2e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:48.988549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:48.989106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:48.989392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:48.989671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:48.991305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:49.066524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:49.080917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:49.082507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f32cd-0e6e-44ec-9a11-65e239f6a956 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:49.099927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 715/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:49.955205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105dea8-5948-45c6-9e7e-b9b298764ee0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:49.955718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105dea8-5948-45c6-9e7e-b9b298764ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:49.955816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105dea8-5948-45c6-9e7e-b9b298764ee0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:49.957190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:49.961978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fb5d-8469-4d03-a517-8826f56c4ad4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:49.962358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fb5d-8469-4d03-a517-8826f56c4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:49.962542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fb5d-8469-4d03-a517-8826f56c4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:50.035523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c7f9fb5d-8469-4d03-a517-8826f56c4ad4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:50.036689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c7f9fb5d-8469-4d03-a517-8826f56c4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:50.130258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:50.280500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105dea8-5948-45c6-9e7e-b9b298764ee0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:50.282643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5105dea8-5948-45c6-9e7e-b9b298764ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:50.365036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:50.425023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105dea8-5948-45c6-9e7e-b9b298764ee0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:50.533892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:50.534527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:50.534807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:50.535082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:50.536879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:50.583795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:50.623487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:50.625622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8603117-ec63-4d9b-acbc-34f5ffefcd55 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:50.644313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 712/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:51.433245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab31e2-ce80-4d71-9fe6-4652e2966585 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:51.433823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab31e2-ce80-4d71-9fe6-4652e2966585 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:51.433823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab31e2-ce80-4d71-9fe6-4652e2966585 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:51.435165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:51.440214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213b5a-185c-49ef-a16a-27b0447d72a0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:51.440625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213b5a-185c-49ef-a16a-27b0447d72a0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:51.440744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213b5a-185c-49ef-a16a-27b0447d72a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:51.513745 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d8213b5a-185c-49ef-a16a-27b0447d72a0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:51.514924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d8213b5a-185c-49ef-a16a-27b0447d72a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:51.608716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:51.757589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab31e2-ce80-4d71-9fe6-4652e2966585 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:51.759028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f6ab31e2-ce80-4d71-9fe6-4652e2966585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:51.815612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:51.911008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab31e2-ce80-4d71-9fe6-4652e2966585 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:52.020815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:52.021388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:52.021670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:52.021945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:52.023575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:52.030338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:52.110996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:52.112599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb8ce0-6431-4141-90b1-99574cdf0c33 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:52.130324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 718/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:52.929021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958a624-8e16-4092-90bb-10240d4279bf None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:52.929531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958a624-8e16-4092-90bb-10240d4279bf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:52.929625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958a624-8e16-4092-90bb-10240d4279bf None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:52.931017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:52.935961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51e02-8989-42ec-8d6a-c219e57d9e4e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:52.936404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51e02-8989-42ec-8d6a-c219e57d9e4e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:52.936548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51e02-8989-42ec-8d6a-c219e57d9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:53.010586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f4b51e02-8989-42ec-8d6a-c219e57d9e4e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:53.011814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f4b51e02-8989-42ec-8d6a-c219e57d9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:53.077381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:53.106296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:53.254420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958a624-8e16-4092-90bb-10240d4279bf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:53.255934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6958a624-8e16-4092-90bb-10240d4279bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:53.274324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:53.401053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958a624-8e16-4092-90bb-10240d4279bf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:53.486831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:53.512008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:53.512611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:53.512900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:53.513183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:53.514835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:53.602269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:53.603861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734a9fd-b8f8-4b89-b484-0a9c5d00f2e5 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:53.621486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 715/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:54.417669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148fcdf-332f-4156-becc-47243b270a93 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:54.418254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148fcdf-332f-4156-becc-47243b270a93 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:54.418254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148fcdf-332f-4156-becc-47243b270a93 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:54.419609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:54.424396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc253-2902-43ff-8cdc-77f9705e8476 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:54.424839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc253-2902-43ff-8cdc-77f9705e8476 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:54.424946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc253-2902-43ff-8cdc-77f9705e8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:54.500705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c6bcc253-2902-43ff-8cdc-77f9705e8476 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:54.501898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c6bcc253-2902-43ff-8cdc-77f9705e8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:54.542674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:54.597760 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:54.748253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148fcdf-332f-4156-becc-47243b270a93 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:54.749757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6148fcdf-332f-4156-becc-47243b270a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:54.894507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148fcdf-332f-4156-becc-47243b270a93 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:54.947921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:55.009435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:55.010103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:55.010390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:55.010689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:55.012384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:55.104778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:55.106371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2176fda-8a9e-45ef-9262-c00648cf773f service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:55.124920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 721/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:55.924465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb6d4f-0361-4e19-9f6c-2148e5aabb8a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:55.924939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb6d4f-0361-4e19-9f6c-2148e5aabb8a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:55.925035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb6d4f-0361-4e19-9f6c-2148e5aabb8a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:55.926385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:55.931317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a3e9-6de0-4811-991c-dfc69e23ddf4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:55.931814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a3e9-6de0-4811-991c-dfc69e23ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:55.931922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7a3e9-6de0-4811-991c-dfc69e23ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:56.004840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f9e7a3e9-6de0-4811-991c-dfc69e23ddf4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:56.006027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f9e7a3e9-6de0-4811-991c-dfc69e23ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:56.007986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:56.100767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:56.248391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb6d4f-0361-4e19-9f6c-2148e5aabb8a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:56.249947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aabb6d4f-0361-4e19-9f6c-2148e5aabb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:56.393409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb6d4f-0361-4e19-9f6c-2148e5aabb8a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:56.419101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:56.503188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:56.503834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:56.504150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:56.504427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:56.506044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:56.593558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:56.595174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9f5a0-f8d7-418b-8de8-b573958df735 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:56.612768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 718/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:58.545714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74b4b-045f-4e32-8696-20240448c29b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:58.546290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74b4b-045f-4e32-8696-20240448c29b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:58.546290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74b4b-045f-4e32-8696-20240448c29b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:58.548211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:58.554028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85201c4-2ab1-4bd4-87cb-a8413d41ed4f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:58.554468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85201c4-2ab1-4bd4-87cb-a8413d41ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:58.554572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85201c4-2ab1-4bd4-87cb-a8413d41ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:58.594759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:58.621452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b85201c4-2ab1-4bd4-87cb-a8413d41ed4f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:58.622655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b85201c4-2ab1-4bd4-87cb-a8413d41ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:58.720254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:58.761004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74b4b-045f-4e32-8696-20240448c29b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:58.762548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9bb74b4b-045f-4e32-8696-20240448c29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:58.866014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74b4b-045f-4e32-8696-20240448c29b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:58.896947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:58.938594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:58.939236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:58.939514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:58.939785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:58.941431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:59.048602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:59.049947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefbbc4-c5c8-4fed-a410-33a469d04d40 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:59.069065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 724/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:01.295398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3242ba-860e-4cab-9a01-e8c6a186a94d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:01.295955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3242ba-860e-4cab-9a01-e8c6a186a94d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:01.295955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3242ba-860e-4cab-9a01-e8c6a186a94d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:01.297860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:01.303108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cbd84-32b3-4eab-b479-1a571aebdd19 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:01.303534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cbd84-32b3-4eab-b479-1a571aebdd19 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:01.303662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cbd84-32b3-4eab-b479-1a571aebdd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:01.378910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-685cbd84-32b3-4eab-b479-1a571aebdd19 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:01.380145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-685cbd84-32b3-4eab-b479-1a571aebdd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:01.403069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:01.490980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:01.528471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3242ba-860e-4cab-9a01-e8c6a186a94d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:01.530004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7b3242ba-860e-4cab-9a01-e8c6a186a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:01.632837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3242ba-860e-4cab-9a01-e8c6a186a94d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:01.646391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:01.711327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:01.711985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:01.712294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:01.712568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:01.714223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:01.843917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:01.845401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab3da-a9bd-4aba-9641-62cd7c2d723c service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:01.863951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 721/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:04.217510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed763871-9e46-4c50-9739-36b9ea39ab61 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:04.218071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed763871-9e46-4c50-9739-36b9ea39ab61 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:04.218071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed763871-9e46-4c50-9739-36b9ea39ab61 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:04.220026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:04.225141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7569c-f700-4f44-9dbf-b963fcf24b24 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:04.225597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7569c-f700-4f44-9dbf-b963fcf24b24 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:04.225705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7569c-f700-4f44-9dbf-b963fcf24b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:04.271322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:04.289634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-17d7569c-f700-4f44-9dbf-b963fcf24b24 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:04.290855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-17d7569c-f700-4f44-9dbf-b963fcf24b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:04.387386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:04.426102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed763871-9e46-4c50-9739-36b9ea39ab61 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:04.427659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ed763871-9e46-4c50-9739-36b9ea39ab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:04.530042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed763871-9e46-4c50-9739-36b9ea39ab61 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:04.569325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:04.603083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:04.603724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:04.604010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:04.604319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:04.605954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:04.713299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:04.714724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16b261-0348-44bf-bf92-ff911c42fd50 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:04.732750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 727/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:06.883820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7a42-04af-4e48-a26d-a0f4ea1c416c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:06.884341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7a42-04af-4e48-a26d-a0f4ea1c416c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:06.884454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e7a42-04af-4e48-a26d-a0f4ea1c416c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:06.885788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:06.891766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e2c7-3c22-4b6d-b5d7-3c8d06b3103e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:06.892229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e2c7-3c22-4b6d-b5d7-3c8d06b3103e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:06.892392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9e2c7-3c22-4b6d-b5d7-3c8d06b3103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:06.957347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3eb9e2c7-3c22-4b6d-b5d7-3c8d06b3103e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:06.958557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3eb9e2c7-3c22-4b6d-b5d7-3c8d06b3103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:06.978528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:07.053607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:07.091305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7a42-04af-4e48-a26d-a0f4ea1c416c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:07.092874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6c0e7a42-04af-4e48-a26d-a0f4ea1c416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:07.194522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e7a42-04af-4e48-a26d-a0f4ea1c416c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:07.214376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:07.267287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:07.267932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:07.268245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:07.268519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:07.270146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:07.376999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:07.378471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83e8bb-0f30-4974-b958-e4b5f8265aeb service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:07.396950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 724/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:09.525235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0f814-f135-4194-8012-b0f096a8b79e None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:09.525800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0f814-f135-4194-8012-b0f096a8b79e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:09.525800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0f814-f135-4194-8012-b0f096a8b79e None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:09.527160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:09.532569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573a87-b405-4d89-bfe9-300aacfe9d67 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:09.532961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573a87-b405-4d89-bfe9-300aacfe9d67 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:09.533130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573a87-b405-4d89-bfe9-300aacfe9d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:09.594386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:09.597509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-be573a87-b405-4d89-bfe9-300aacfe9d67 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:09.599047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-be573a87-b405-4d89-bfe9-300aacfe9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:09.694327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:09.733096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0f814-f135-4194-8012-b0f096a8b79e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:09.734611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5cf0f814-f135-4194-8012-b0f096a8b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:09.836008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0f814-f135-4194-8012-b0f096a8b79e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:09.885572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:09.910024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:09.910666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:09.910944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:09.911215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:09.912874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:10.018503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:10.019928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97c433-8305-4a85-bc1f-5cded58c7e32 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:10.037789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 730/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:47:12.142503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2679e-f43c-44af-a383-f09ffddb3b82 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:12.143016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2679e-f43c-44af-a383-f09ffddb3b82 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:12.143016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2679e-f43c-44af-a383-f09ffddb3b82 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:12.144392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:12.149702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1204-1408-48f4-a87a-8d7a424bf3bd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:12.150129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1204-1408-48f4-a87a-8d7a424bf3bd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:12.150299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1204-1408-48f4-a87a-8d7a424bf3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:12.214899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7c2f1204-1408-48f4-a87a-8d7a424bf3bd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:12.216137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7c2f1204-1408-48f4-a87a-8d7a424bf3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:12.244209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:12.312531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:12.349967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2679e-f43c-44af-a383-f09ffddb3b82 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:12.351537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-33b2679e-f43c-44af-a383-f09ffddb3b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:12.454959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2679e-f43c-44af-a383-f09ffddb3b82 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:12.481827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:12.527099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:12.527747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:12.528031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:12.528337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:12.529983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:12.637081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:12.638508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7dced-6929-4656-98ce-4eff1c2178c9 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:12.658450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 727/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:14.708296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d82490-7212-4d5c-966f-aef85f2ded2f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:14.708863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d82490-7212-4d5c-966f-aef85f2ded2f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:14.708863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d82490-7212-4d5c-966f-aef85f2ded2f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:14.710231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:14.715446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3eb0-3b3e-49f5-8430-97fa57a50587 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:14.716013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3eb0-3b3e-49f5-8430-97fa57a50587 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:14.716013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3eb0-3b3e-49f5-8430-97fa57a50587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:14.778725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-364b3eb0-3b3e-49f5-8430-97fa57a50587 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:14.779914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-364b3eb0-3b3e-49f5-8430-97fa57a50587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:14.788595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:14.874415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:14.911989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d82490-7212-4d5c-966f-aef85f2ded2f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:14.913558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-30d82490-7212-4d5c-966f-aef85f2ded2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:15.013598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d82490-7212-4d5c-966f-aef85f2ded2f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:15.066991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:15.085530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:15.086168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:15.086445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:15.086714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:15.088344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:15.193873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:15.195310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fa70-a540-4762-83f5-0bde7afaf354 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:15.214199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 733/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:17.280698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f534-f6d8-4d59-ba84-941d6fc565ac None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:17.281264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f534-f6d8-4d59-ba84-941d6fc565ac None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:17.281264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f534-f6d8-4d59-ba84-941d6fc565ac None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:17.282634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:47:17.287889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19861a-02e1-4e99-bc76-71f0117a6ae1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:17.288320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19861a-02e1-4e99-bc76-71f0117a6ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:17.288467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19861a-02e1-4e99-bc76-71f0117a6ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:17.352229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9c19861a-02e1-4e99-bc76-71f0117a6ae1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:17.353420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9c19861a-02e1-4e99-bc76-71f0117a6ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:17.391487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:17.449526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:17.487085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f534-f6d8-4d59-ba84-941d6fc565ac None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:17.488632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1332f534-f6d8-4d59-ba84-941d6fc565ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:17.591113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f534-f6d8-4d59-ba84-941d6fc565ac None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:17.627830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:17.663834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:17.664501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:17.664788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:17.665065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:17.666741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:17.774432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:17.775844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f31b-7dce-4556-81ca-c152905c0de0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:17.793325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 730/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:19.846292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ebc1f-c6e3-4cd2-939c-2e799c0f704f None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:19.846879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ebc1f-c6e3-4cd2-939c-2e799c0f704f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:19.846879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ebc1f-c6e3-4cd2-939c-2e799c0f704f None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:19.848287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:19.853492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a8258-9546-46a8-a948-d8f39b92f4f4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:19.853927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a8258-9546-46a8-a948-d8f39b92f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:19.854063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a8258-9546-46a8-a948-d8f39b92f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:19.919521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6d1a8258-9546-46a8-a948-d8f39b92f4f4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:19.921246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d1a8258-9546-46a8-a948-d8f39b92f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:19.939434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:20.018497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:20.054612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ebc1f-c6e3-4cd2-939c-2e799c0f704f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:20.056215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-337ebc1f-c6e3-4cd2-939c-2e799c0f704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:20.158034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ebc1f-c6e3-4cd2-939c-2e799c0f704f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:20.224171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:20.230989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:20.231636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:20.231920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:20.232235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:20.234396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:20.342450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:20.344407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39777b-8a8c-46fb-8d61-220470aff647 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:20.363205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 736/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:22.395338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529bacc-d6a8-4b5d-8862-de9e735e9421 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:22.395874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529bacc-d6a8-4b5d-8862-de9e735e9421 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:22.395874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529bacc-d6a8-4b5d-8862-de9e735e9421 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:22.397369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:22.402593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10537-1780-4067-8ab3-2a59611fb067 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:22.403014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10537-1780-4067-8ab3-2a59611fb067 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:22.403131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10537-1780-4067-8ab3-2a59611fb067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:22.466191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ecc10537-1780-4067-8ab3-2a59611fb067 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:22.467393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ecc10537-1780-4067-8ab3-2a59611fb067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:22.513908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:22.563638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:22.600230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529bacc-d6a8-4b5d-8862-de9e735e9421 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:22.601757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7529bacc-d6a8-4b5d-8862-de9e735e9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:22.705099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529bacc-d6a8-4b5d-8862-de9e735e9421 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:22.751613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:22.777906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:22.778547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:22.778831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:22.779106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:22.780765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:22.887957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:22.890013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01ac99-41ac-4327-b766-430d38b7639b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:22.907963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 733/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:32.562516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=22 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:32.905723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=66 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:42.454530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d725-df83-4aea-a23b-3d08974b407d None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:42.455061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d725-df83-4aea-a23b-3d08974b407d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:42.455061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d725-df83-4aea-a23b-3d08974b407d None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:42.456481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 738/1471] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:42.461849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8cbd-c5c7-4e65-b383-9a4ef89cb772 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:42.462267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8cbd-c5c7-4e65-b383-9a4ef89cb772 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:42.462471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8cbd-c5c7-4e65-b383-9a4ef89cb772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:42.526592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-00cd8cbd-c5c7-4e65-b383-9a4ef89cb772 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:42.527709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-00cd8cbd-c5c7-4e65-b383-9a4ef89cb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:42.620427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 734/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:42.703234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a9c67-9e6a-43b9-8a95-d927361c2763 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:42.703521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a9c67-9e6a-43b9-8a95-d927361c2763 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:42.703800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a9c67-9e6a-43b9-8a95-d927361c2763 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:42.705210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 739/1473] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 14 10:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:42.709902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec5de5-0565-4320-96c1-7b75a849bcb0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:42.710186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec5de5-0565-4320-96c1-7b75a849bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:42.710462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec5de5-0565-4320-96c1-7b75a849bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:42.781954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6fec5de5-0565-4320-96c1-7b75a849bcb0 None None] MFA Rules not processed for user `eb4489f887f944f0806b63b669ffb883`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:42.783072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6fec5de5-0565-4320-96c1-7b75a849bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:42.803319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:42.859860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 735/1474] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 14 10:47:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:42.867678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a9c67-9e6a-43b9-8a95-d927361c2763 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:42.869289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-637a9c67-9e6a-43b9-8a95-d927361c2763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:42.970862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a9c67-9e6a-43b9-8a95-d927361c2763 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:43.041813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:43.042415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:43.042692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:43.042964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:43.044607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:43.097977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:43.151555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:43.153008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ab8b1-087d-48d9-b27c-a7ccd2889fd6 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:43.172310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 740/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:45.284919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597f5d-95ae-43fe-8f4c-5f43edac025b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:45.285484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597f5d-95ae-43fe-8f4c-5f43edac025b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:45.285484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597f5d-95ae-43fe-8f4c-5f43edac025b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:45.286901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 736/1476] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:45.292007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2242-1e35-4c63-95e3-e74c25660d17 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:45.292472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2242-1e35-4c63-95e3-e74c25660d17 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:45.292604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2242-1e35-4c63-95e3-e74c25660d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:45.357281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f87e2242-1e35-4c63-95e3-e74c25660d17 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:45.358503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f87e2242-1e35-4c63-95e3-e74c25660d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:45.453995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 741/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:45.476919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3597f5d-95ae-43fe-8f4c-5f43edac025b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:45.478426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a3597f5d-95ae-43fe-8f4c-5f43edac025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:45.600630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3597f5d-95ae-43fe-8f4c-5f43edac025b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:45.649031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:45.693201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:45.693851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:45.694134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:45.694405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:45.695117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:45.696899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:47:45.696899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:47:45.696899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:47:45.698038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d280e8-6771-430c-a3c8-cfe1bd8fe983 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:45.717461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 737/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 14 10:47:45 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:47:47.754935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a577-3799-46c8-8f62-dc1ca808c624 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:47.755500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a577-3799-46c8-8f62-dc1ca808c624 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:47.755500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a577-3799-46c8-8f62-dc1ca808c624 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:47.756888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 742/1479] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:47.762206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b870c46-a195-4574-9080-778ada09fe86 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:47.762620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b870c46-a195-4574-9080-778ada09fe86 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:47.762761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b870c46-a195-4574-9080-778ada09fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:47.826091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7b870c46-a195-4574-9080-778ada09fe86 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:47.827324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7b870c46-a195-4574-9080-778ada09fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:47.924628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 738/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:47.971551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a577-3799-46c8-8f62-dc1ca808c624 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:47.973267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a9e8a577-3799-46c8-8f62-dc1ca808c624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:47.983516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:48.122108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a577-3799-46c8-8f62-dc1ca808c624 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:48.200377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:48.234046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:48.234690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:48.234967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:48.235238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:48.236900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:48.325290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:48.326943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85fb9c-5348-428f-88b3-cea0555ea55d service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:48.345154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 743/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:50.558521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b3e7-cd30-4361-858b-afc6b40fd6ea None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:50.559057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b3e7-cd30-4361-858b-afc6b40fd6ea None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:50.559057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b3e7-cd30-4361-858b-afc6b40fd6ea None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:50.560515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 739/1482] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:50.565753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456086a-fb59-4260-903a-6395b7cf35c8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:50.566147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456086a-fb59-4260-903a-6395b7cf35c8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:50.566330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456086a-fb59-4260-903a-6395b7cf35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:50.630234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a456086a-fb59-4260-903a-6395b7cf35c8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:50.631450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a456086a-fb59-4260-903a-6395b7cf35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:50.678190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:50.728674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 744/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:50.764207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b3e7-cd30-4361-858b-afc6b40fd6ea None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:50.765740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d0b5b3e7-cd30-4361-858b-afc6b40fd6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:50.789333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:50.867493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b3e7-cd30-4361-858b-afc6b40fd6ea None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:50.938356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:50.938990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:50.939273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:50.939543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:50.941189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:51.015875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:51.050476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:51.051914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d549b-e1a9-4200-8f55-ef466c1a3f6a service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:51.070453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 740/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:53.145050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ffdc-aabd-4fe6-a3a0-a7e64b8273f5 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:53.145595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ffdc-aabd-4fe6-a3a0-a7e64b8273f5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:53.145595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3ffdc-aabd-4fe6-a3a0-a7e64b8273f5 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:53.146914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 745/1485] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:53.152084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80e76-c538-4e61-9c8f-d2cc26c065ed None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:53.152473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80e76-c538-4e61-9c8f-d2cc26c065ed None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:53.152652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80e76-c538-4e61-9c8f-d2cc26c065ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:53.217221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a5b80e76-c538-4e61-9c8f-d2cc26c065ed None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:53.218438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a5b80e76-c538-4e61-9c8f-d2cc26c065ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:53.312642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 741/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:53.350041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3ffdc-aabd-4fe6-a3a0-a7e64b8273f5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:53.351569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e2d3ffdc-aabd-4fe6-a3a0-a7e64b8273f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:53.453534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3ffdc-aabd-4fe6-a3a0-a7e64b8273f5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:53.522626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:53.524574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:53.525242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:53.525758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:53.526063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:53.528143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:53.634849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:53.636313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381539f-3a7f-4347-8715-241a8dd6d5c7 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:53.655303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 746/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:55.754443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0e1da-d3a7-4cf8-aa2c-2e725b66bdf8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:55.755020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0e1da-d3a7-4cf8-aa2c-2e725b66bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:55.755020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0e1da-d3a7-4cf8-aa2c-2e725b66bdf8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:55.756382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 742/1488] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:55.761529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39746b9-555d-4d4b-ae22-b747335a54f6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:55.761934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39746b9-555d-4d4b-ae22-b747335a54f6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:55.762100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39746b9-555d-4d4b-ae22-b747335a54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:55.825641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b39746b9-555d-4d4b-ae22-b747335a54f6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:55.826856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b39746b9-555d-4d4b-ae22-b747335a54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:55.879244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:55.923246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 747/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:55.965035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0e1da-d3a7-4cf8-aa2c-2e725b66bdf8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:55.966636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f3e0e1da-d3a7-4cf8-aa2c-2e725b66bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:56.011643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:56.079460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0e1da-d3a7-4cf8-aa2c-2e725b66bdf8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:56.150138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:56.150779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:56.151064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:56.151343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:56.153032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:56.236154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:56.265567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:56.266933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dd027-2de9-4405-a0bf-7ee273d59fe2 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:56.285940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 743/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:58.536837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf03f-69b9-4040-a4f4-13aa7c80009b None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:58.537366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf03f-69b9-4040-a4f4-13aa7c80009b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:58.537501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf03f-69b9-4040-a4f4-13aa7c80009b None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:58.538806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 748/1491] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 14 10:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:58.544213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d2707-8e9b-47fc-9c8d-0330ed807583 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:58.544654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d2707-8e9b-47fc-9c8d-0330ed807583 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:58.544794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d2707-8e9b-47fc-9c8d-0330ed807583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:58.608135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d31d2707-8e9b-47fc-9c8d-0330ed807583 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:58.609339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d31d2707-8e9b-47fc-9c8d-0330ed807583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:58.705049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 744/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:58.742911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf03f-69b9-4040-a4f4-13aa7c80009b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:58.744510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-17adf03f-69b9-4040-a4f4-13aa7c80009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:58.847447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf03f-69b9-4040-a4f4-13aa7c80009b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:58.920743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:58.921383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:58.921659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:58.921930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:58.923541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:58.932334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:59.035672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:59.037114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12aff-3077-4929-b7ce-69883f57cf26 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:59.055947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 749/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:48:08.703204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=82 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:09.053783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=50 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:24.997232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:24.997817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:24.997817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:25.072891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:49:25.074104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:25.167743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 745/1494] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:49:25.175995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:25.176502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:25.176608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:25.251189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:49:25.252437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:25.347253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 750/1495] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:49:25.351886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:25.353663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:25.364940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229c01-38cf-41d7-8bf9-d8e405c947c2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:25.425840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:25.459557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:25.460249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:25.460536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:25.460815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:25.461537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:49:25.461846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:25.462856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:25.462856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:49:25.462856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:49:25.463750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:25.474667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 746/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:49:25.483222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:25.492348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a47-6992-484d-b5ab-de6f6a6d5de9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:25.552729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:25.586803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:25.587989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:25.588298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:25.588575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:25.589271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:25.590993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:25.590993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:49:25.590993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:49:25.592224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:25.646490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 751/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:49:25 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:49:25.651244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:25.652828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:25.687591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719da8-cc6a-4e61-b3fd-c3858c505eaa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:25.779597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:25.780284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:25.780565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:25.780845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:25.781533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:25.782538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:25.782538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:49:25.782538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:49:25.783754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:25.823365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 747/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:49:25 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:49:25.827400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:25.828999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:25.890231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96296101-4ca3-4fdd-ad62-17698e4aeb3e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:25.973524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:25.985575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:25.986252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:25.986538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:25.986816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:25.987546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:25.988583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:25.988583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:49:25.988583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:49:25.989473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:26.001692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 752/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:49:26.005655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:26.007210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:26.019150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6895fb-fbd3-4f0b-8803-c856726a8d96 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:26.043969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:26.113471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:26.114138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.114425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.114705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.115457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:26.116558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:26.116558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:49:26.116558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:49:26.117435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3349f2-396f-421c-b8e9-f681edd3e036 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:26.130036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 748/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:49:26.134149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:26.135670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:26.169400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae872-1959-4fa2-8e63-46456957a271 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:26.261381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:26.262185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.262462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.262733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] PATH_INFO: `/v3/projects/146f312d9dfe419499cff8dc4e766b48/users/5b43b881976e48c6881e0bace8140530/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.284229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146f312d9dfe419499cff8dc4e766b48, user_id=5b43b881976e48c6881e0bace8140530, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:26.285246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:26.285246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:49:26.285246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:49:26.287164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbed49-82c7-4ef1-84f4-e2a3c38cf9e9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:26.311999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 753/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:49:26 2022] PUT /identity/v3/projects/146f312d9dfe419499cff8dc4e766b48/users/5b43b881976e48c6881e0bace8140530/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:49:26.324242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b0d85-7b28-4bcd-b947-c2185dd116b6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.324537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b0d85-7b28-4bcd-b947-c2185dd116b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.324819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b0d85-7b28-4bcd-b947-c2185dd116b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.379698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e00b0d85-7b28-4bcd-b947-c2185dd116b6 None None] MFA Rules not processed for user `5b43b881976e48c6881e0bace8140530`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:49:26.380954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e00b0d85-7b28-4bcd-b947-c2185dd116b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:26.456663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 749/1502] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:49:26.470044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764fe9-1661-4e66-9b46-a6c7112561fc None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.470340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764fe9-1661-4e66-9b46-a6c7112561fc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.470630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764fe9-1661-4e66-9b46-a6c7112561fc None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.472001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 754/1503] 10.222.0.64 () {54 vars in 963 bytes} [Thu Jul 14 10:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:49:26.476790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e4dea-e5dc-4ce3-90db-eb65d46e7e7d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.477082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e4dea-e5dc-4ce3-90db-eb65d46e7e7d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.477361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e4dea-e5dc-4ce3-90db-eb65d46e7e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.507253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:26.552567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-143e4dea-e5dc-4ce3-90db-eb65d46e7e7d None None] MFA Rules not processed for user `b7de00325c784e79be24c9928dd535e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:49:26.553731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-143e4dea-e5dc-4ce3-90db-eb65d46e7e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:26.628243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 750/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Thu Jul 14 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:49:26.635885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764fe9-1661-4e66-9b46-a6c7112561fc None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:26.637451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aa764fe9-1661-4e66-9b46-a6c7112561fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:26.689282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:26.743929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764fe9-1661-4e66-9b46-a6c7112561fc None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:26.819065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:26.819627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.819904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.820204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.822321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:26.921008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:26.922450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:26.926049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:26.941043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 755/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:49:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:49:26.991565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce2f49-8ddb-4c63-afad-f90a01f247fa None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:26.991853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce2f49-8ddb-4c63-afad-f90a01f247fa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:26.992177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce2f49-8ddb-4c63-afad-f90a01f247fa None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:26.993539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 751/1506] 10.222.0.64 () {52 vars in 829 bytes} [Thu Jul 14 10:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:49:26.997451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:26.998682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:27.096962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998278d0-ad44-4c57-a7d9-2b4f29da8f50 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:27.190025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:27.190895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:27.191177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:27.191452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] PATH_INFO: `/v3/users/5b43b881976e48c6881e0bace8140530` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:27.206670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b43b881976e48c6881e0bace8140530)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:27.207708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:27.207708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:49:27.207708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:49:27.208961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:27.218858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:27.272724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b43b881976e48c6881e0bace8140530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:27.273368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b43b881976e48c6881e0bace8140530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:27.291200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b43b881976e48c6881e0bace8140530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:27.303073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b43b881976e48c6881e0bace8140530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:27.313443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b43b881976e48c6881e0bace8140530'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:27.319068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 756/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:49:26 2022] DELETE /identity/v3/users/5b43b881976e48c6881e0bace8140530 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:49:27.324344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:27.324797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:27.324930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:27.378595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:49:27.379734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:27.453333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:27.466488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 752/1508] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:49:27.475783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:27.477076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:27.577439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5fec-ca37-4744-bac3-90b82db0dca3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:27.629965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:27.650267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:27.650914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:27.651201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:27.651483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:27.653167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:27.759138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:27.760593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd1ca-ae3a-44f0-b11e-04ce529e2a71 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:27.778547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 757/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:49:28.219963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:49:28.221256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:49:28.232786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6918-af3e-4bc9-b03c-ed48a5b70289 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:49:28.329527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:49:28.330396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:49:28.330680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:49:28.330956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] PATH_INFO: `/v3/projects/146f312d9dfe419499cff8dc4e766b48` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:49:28.341704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=146f312d9dfe419499cff8dc4e766b48)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:49:28.342731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:49:28.342731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:49:28.342731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:49:28.343950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:49:28.402453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146f312d9dfe419499cff8dc4e766b48', 'request_id': 'req-ce1ede95-de54-460a-b3c5-26af0e2f8500'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:28.408429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146f312d9dfe419499cff8dc4e766b48', 'request_id': 'req-ce1ede95-de54-460a-b3c5-26af0e2f8500'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:28.417081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146f312d9dfe419499cff8dc4e766b48', 'request_id': 'req-ce1ede95-de54-460a-b3c5-26af0e2f8500'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:28.446146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] The token cache is being invalidate because project 146f312d9dfe419499cff8dc4e766b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:49:28.446430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:28.447346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ce1ede95-de54-460a-b3c5-26af0e2f8500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:49:28.449087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 753/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:49:28 2022] DELETE /identity/v3/projects/146f312d9dfe419499cff8dc4e766b48 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:49:37.776239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=62 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:38.444118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:15.540414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b026fd-c50e-48a8-8933-758b8bc90371 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:15.541039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b026fd-c50e-48a8-8933-758b8bc90371 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:15.541039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b026fd-c50e-48a8-8933-758b8bc90371 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:15.542355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:15.547238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154343c-e3ec-44b6-bebd-00e4d9bf4fdf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:15.547677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154343c-e3ec-44b6-bebd-00e4d9bf4fdf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:15.547791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154343c-e3ec-44b6-bebd-00e4d9bf4fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:15.745987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a154343c-e3ec-44b6-bebd-00e4d9bf4fdf None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:15.747175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a154343c-e3ec-44b6-bebd-00e4d9bf4fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:15.847677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:16.001398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b026fd-c50e-48a8-8933-758b8bc90371 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:16.003622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f0b026fd-c50e-48a8-8933-758b8bc90371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:16.121208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b026fd-c50e-48a8-8933-758b8bc90371 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:16.126632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59c08-9764-47b5-b18c-93b197cf1362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:16.127279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59c08-9764-47b5-b18c-93b197cf1362 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:16.127566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59c08-9764-47b5-b18c-93b197cf1362 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:16.127846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59c08-9764-47b5-b18c-93b197cf1362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:16.135814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b59c08-9764-47b5-b18c-93b197cf1362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:16.137413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b59c08-9764-47b5-b18c-93b197cf1362 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:16.146739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 759/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:16.972853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab5ea0-ccc1-466a-a3c0-55fd07f91662 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:16.973417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab5ea0-ccc1-466a-a3c0-55fd07f91662 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:16.973632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab5ea0-ccc1-466a-a3c0-55fd07f91662 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:16.975138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:16.980232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5442-64e8-4b1f-a713-215bd44ce765 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:16.980714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5442-64e8-4b1f-a713-215bd44ce765 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:16.980811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5442-64e8-4b1f-a713-215bd44ce765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:16.998995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-71db5442-64e8-4b1f-a713-215bd44ce765 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:17.000219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-71db5442-64e8-4b1f-a713-215bd44ce765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:17.008014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:17.160319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab5ea0-ccc1-466a-a3c0-55fd07f91662 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:17.174779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab5ea0-ccc1-466a-a3c0-55fd07f91662 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:17.188815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2def1-37a1-4aec-8ce9-ca5869d52cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:17.189465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2def1-37a1-4aec-8ce9-ca5869d52cdd service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:17.189746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2def1-37a1-4aec-8ce9-ca5869d52cdd service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:17.190023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2def1-37a1-4aec-8ce9-ca5869d52cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:17.199188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2def1-37a1-4aec-8ce9-ca5869d52cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:17.200856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2def1-37a1-4aec-8ce9-ca5869d52cdd service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:17.216230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 756/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:17.576109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70514f-5afd-4d5e-98a4-d721ecb32693 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:17.576400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70514f-5afd-4d5e-98a4-d721ecb32693 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:17.576681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70514f-5afd-4d5e-98a4-d721ecb32693 None None] PATH_INFO: `/v3` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:17.577994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 761/1517] 10.222.0.66 () {54 vars in 925 bytes} [Thu Jul 14 10:51:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:51:17.606978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debbc1c-8af2-4881-8b54-b357a17c3909 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:17.607883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debbc1c-8af2-4881-8b54-b357a17c3909 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:17.608190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debbc1c-8af2-4881-8b54-b357a17c3909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:17.663575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2debbc1c-8af2-4881-8b54-b357a17c3909 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:17.664784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2debbc1c-8af2-4881-8b54-b357a17c3909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:17.681557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:17.734946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 757/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Jul 14 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:21.542589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a37d2-1f43-4425-acfc-71dd8cb280f1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:21.543130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a37d2-1f43-4425-acfc-71dd8cb280f1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:21.543130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a37d2-1f43-4425-acfc-71dd8cb280f1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:21.545179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 762/1519] 10.222.0.64 () {54 vars in 960 bytes} [Thu Jul 14 10:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:21.549983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fec2a-ebf3-4dba-96a6-3030833ba57e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:21.550394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fec2a-ebf3-4dba-96a6-3030833ba57e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:21.550607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fec2a-ebf3-4dba-96a6-3030833ba57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:21.568122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dc3fec2a-ebf3-4dba-96a6-3030833ba57e None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:21.569335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dc3fec2a-ebf3-4dba-96a6-3030833ba57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:21.578283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 758/1520] 10.222.0.64 () {58 vars in 1057 bytes} [Thu Jul 14 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:21.586071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a37d2-1f43-4425-acfc-71dd8cb280f1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:21.599848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a37d2-1f43-4425-acfc-71dd8cb280f1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:21.604959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eb692-f53d-41ab-ab98-c2abaa86f53f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:21.605674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eb692-f53d-41ab-ab98-c2abaa86f53f service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:21.605965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eb692-f53d-41ab-ab98-c2abaa86f53f service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:21.606302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eb692-f53d-41ab-ab98-c2abaa86f53f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:21.616498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eb692-f53d-41ab-ab98-c2abaa86f53f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:21.618084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eb692-f53d-41ab-ab98-c2abaa86f53f service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:21.627664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 763/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:28.633536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec38f4-f262-416e-b914-da34ec5f91e4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:28.634131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec38f4-f262-416e-b914-da34ec5f91e4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:28.634131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec38f4-f262-416e-b914-da34ec5f91e4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:28.635436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:28.640347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16046-e661-4581-993e-55a52156da64 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:28.640769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16046-e661-4581-993e-55a52156da64 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:28.640909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16046-e661-4581-993e-55a52156da64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:28.659134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1ab16046-e661-4581-993e-55a52156da64 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:28.660470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1ab16046-e661-4581-993e-55a52156da64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:28.668766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:28.823674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec38f4-f262-416e-b914-da34ec5f91e4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:28.838223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec38f4-f262-416e-b914-da34ec5f91e4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:28.843598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b87f-8b47-4465-b2d4-5dc44a779d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:28.844265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b87f-8b47-4465-b2d4-5dc44a779d37 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:28.844550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b87f-8b47-4465-b2d4-5dc44a779d37 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:28.844841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b87f-8b47-4465-b2d4-5dc44a779d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:28.853305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9b87f-8b47-4465-b2d4-5dc44a779d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:28.854855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9b87f-8b47-4465-b2d4-5dc44a779d37 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:28.864790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 760/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:29.696291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400276a-975c-40fe-977c-866af9a20507 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:29.697121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400276a-975c-40fe-977c-866af9a20507 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:29.697121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400276a-975c-40fe-977c-866af9a20507 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:29.698469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:29.703259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45fff-8761-4979-9276-7b80a8b33731 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:29.703701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45fff-8761-4979-9276-7b80a8b33731 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:29.703806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45fff-8761-4979-9276-7b80a8b33731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:29.721997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0ae45fff-8761-4979-9276-7b80a8b33731 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:29.723188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0ae45fff-8761-4979-9276-7b80a8b33731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:29.730913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:29.883844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400276a-975c-40fe-977c-866af9a20507 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:29.898196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400276a-975c-40fe-977c-866af9a20507 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:29.903605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6edeb0-12a5-4bd9-9703-ff1b7b05ca24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:29.904270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6edeb0-12a5-4bd9-9703-ff1b7b05ca24 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:29.904554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6edeb0-12a5-4bd9-9703-ff1b7b05ca24 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:29.904830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6edeb0-12a5-4bd9-9703-ff1b7b05ca24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:29.912887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6edeb0-12a5-4bd9-9703-ff1b7b05ca24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:29.914465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6edeb0-12a5-4bd9-9703-ff1b7b05ca24 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:29.924189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 766/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:34.254276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0390a1-f4c8-467c-91c4-07d9b9fd6370 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:34.254829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0390a1-f4c8-467c-91c4-07d9b9fd6370 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:34.254829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0390a1-f4c8-467c-91c4-07d9b9fd6370 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:34.256337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:34.261715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44ebc-8b16-4d1b-bfde-680881c087e3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:34.262104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44ebc-8b16-4d1b-bfde-680881c087e3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:34.262246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44ebc-8b16-4d1b-bfde-680881c087e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:34.279783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fee44ebc-8b16-4d1b-bfde-680881c087e3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:34.280996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fee44ebc-8b16-4d1b-bfde-680881c087e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:34.289472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:51:34.361641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0390a1-f4c8-467c-91c4-07d9b9fd6370 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:34.363330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dd0390a1-f4c8-467c-91c4-07d9b9fd6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:34.439285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0390a1-f4c8-467c-91c4-07d9b9fd6370 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:34.442878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2c1d-8e86-43e4-ac56-8ab219ad0577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:34.443552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2c1d-8e86-43e4-ac56-8ab219ad0577 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:34.443835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2c1d-8e86-43e4-ac56-8ab219ad0577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:34.444144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2c1d-8e86-43e4-ac56-8ab219ad0577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:34.453355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac2c1d-8e86-43e4-ac56-8ab219ad0577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:34.455290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac2c1d-8e86-43e4-ac56-8ab219ad0577 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:34.464565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 763/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:51:36.481548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af9fc-519d-424a-956c-4727c607eb11 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:36.482115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af9fc-519d-424a-956c-4727c607eb11 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:36.482115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af9fc-519d-424a-956c-4727c607eb11 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:36.483447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:36.488672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57eb95-bbf9-4300-8c40-c4c39e249160 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:36.489108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57eb95-bbf9-4300-8c40-c4c39e249160 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:36.489254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57eb95-bbf9-4300-8c40-c4c39e249160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:36.507179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fd57eb95-bbf9-4300-8c40-c4c39e249160 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:36.508462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fd57eb95-bbf9-4300-8c40-c4c39e249160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:36.516377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:36.553662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af9fc-519d-424a-956c-4727c607eb11 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:36.555380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-989af9fc-519d-424a-956c-4727c607eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:36.568835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af9fc-519d-424a-956c-4727c607eb11 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:36.572886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2cd1e-b77e-482c-979a-c20ac987ccd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:36.573514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2cd1e-b77e-482c-979a-c20ac987ccd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:36.573798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2cd1e-b77e-482c-979a-c20ac987ccd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:36.574076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2cd1e-b77e-482c-979a-c20ac987ccd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:36.582841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2cd1e-b77e-482c-979a-c20ac987ccd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:36.584375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2cd1e-b77e-482c-979a-c20ac987ccd0 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:36.593911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 769/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:40.179316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfcaa-ae14-47bc-aaa7-cdf6d2313fdf None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:40.179719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfcaa-ae14-47bc-aaa7-cdf6d2313fdf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:40.179883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cfcaa-ae14-47bc-aaa7-cdf6d2313fdf None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:40.181512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:40.186930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604512c8-ae78-4c55-bbe3-5d557a6cc834 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:40.187332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604512c8-ae78-4c55-bbe3-5d557a6cc834 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:40.187469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604512c8-ae78-4c55-bbe3-5d557a6cc834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:40.193895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:40.207091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-604512c8-ae78-4c55-bbe3-5d557a6cc834 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:40.208332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-604512c8-ae78-4c55-bbe3-5d557a6cc834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:40.216113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:40.519580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cfcaa-ae14-47bc-aaa7-cdf6d2313fdf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:40.521310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2c6cfcaa-ae14-47bc-aaa7-cdf6d2313fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:40.585505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:40.599614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cfcaa-ae14-47bc-aaa7-cdf6d2313fdf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:40.603195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c04398-71d8-44bc-86d9-851d55379ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:40.603865 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04398-71d8-44bc-86d9-851d55379ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:40.604181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04398-71d8-44bc-86d9-851d55379ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:40.604462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c04398-71d8-44bc-86d9-851d55379ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:40.613497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c04398-71d8-44bc-86d9-851d55379ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:40.614910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c04398-71d8-44bc-86d9-851d55379ef9 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:40.624325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 766/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:42.659089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa07ea-48e4-4df7-8408-802ae82cfeae None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:42.659627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa07ea-48e4-4df7-8408-802ae82cfeae None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:42.659627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa07ea-48e4-4df7-8408-802ae82cfeae None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:42.661039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:42.666065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d567ea-6c1d-4ae4-8581-7e76f0791ec9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:42.666462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d567ea-6c1d-4ae4-8581-7e76f0791ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:42.666614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d567ea-6c1d-4ae4-8581-7e76f0791ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:42.683602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-46d567ea-6c1d-4ae4-8581-7e76f0791ec9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:42.684819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46d567ea-6c1d-4ae4-8581-7e76f0791ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:42.692514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:42.988356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa07ea-48e4-4df7-8408-802ae82cfeae None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:42.990030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d1aa07ea-48e4-4df7-8408-802ae82cfeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:43.003174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa07ea-48e4-4df7-8408-802ae82cfeae None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:43.006592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56079f6-d20a-4c2a-af32-3166b5511992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:43.007212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56079f6-d20a-4c2a-af32-3166b5511992 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:43.007497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56079f6-d20a-4c2a-af32-3166b5511992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:43.007770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56079f6-d20a-4c2a-af32-3166b5511992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:43.017155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56079f6-d20a-4c2a-af32-3166b5511992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:43.018559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56079f6-d20a-4c2a-af32-3166b5511992 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:43.027680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 772/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:52.679011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=11 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:53.023615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=8 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:18.829908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366a4d-c5dd-4a50-bcbb-ad29c40be766 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.830497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366a4d-c5dd-4a50-bcbb-ad29c40be766 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.830497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a366a4d-c5dd-4a50-bcbb-ad29c40be766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.855891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4a366a4d-c5dd-4a50-bcbb-ad29c40be766 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:18.857155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4a366a4d-c5dd-4a50-bcbb-ad29c40be766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.887778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 768/1540] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:18.900678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.901279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.901279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.909022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791dba-47ba-4449-aaac-f55ee122cef7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.909316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791dba-47ba-4449-aaac-f55ee122cef7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.909606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791dba-47ba-4449-aaac-f55ee122cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.937315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:18.939432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.947607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-04791dba-47ba-4449-aaac-f55ee122cef7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:18.948910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-04791dba-47ba-4449-aaac-f55ee122cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.956280 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 773/1541] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:18.961673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:18.968573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 769/1542] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:18.974662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1df17-b4ff-4e36-b5a0-da5d6323e558 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:18.980657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acd5b-9463-453a-9c24-7a417acdc55e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.981232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acd5b-9463-453a-9c24-7a417acdc55e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.981682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88acd5b-9463-453a-9c24-7a417acdc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.000037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.003480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.003931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.004399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.005312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.005785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.007643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:53:19.007643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:53:19.007643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:53:19.010901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.028088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a88acd5b-9463-453a-9c24-7a417acdc55e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.029869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a88acd5b-9463-453a-9c24-7a417acdc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.044715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 774/1543] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.051996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 770/1544] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.055885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.067236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027824b-cea4-4df0-9411-d560e7cb0949 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.074008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.074505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.074969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.093390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.094317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.095303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.097246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.098261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.098748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.100866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6fbf2-ac22-4017-aa3e-6a5e383fcf4f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.108450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.113936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.129383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 775/1545] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.131201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 771/1546] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.132717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.134284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9350-8dd4-4ae2-bc49-1bf00fabf551 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.135146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9350-8dd4-4ae2-bc49-1bf00fabf551 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.136525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e9350-8dd4-4ae2-bc49-1bf00fabf551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.152709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14772ca6-563a-4a98-ab84-7145ea621341 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.162065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.162879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.163260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.163635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.164674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.166071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:53:19.166071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:53:19.166071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:53:19.166917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f45e9350-8dd4-4ae2-bc49-1bf00fabf551 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.167594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.168503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f45e9350-8dd4-4ae2-bc49-1bf00fabf551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.185557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 776/1547] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.187246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2666-ffc4-47e2-8091-fb14e723a01e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.187787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2666-ffc4-47e2-8091-fb14e723a01e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.189469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa2666-ffc4-47e2-8091-fb14e723a01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.213133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a2fa2666-ffc4-47e2-8091-fb14e723a01e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.214702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2fa2666-ffc4-47e2-8091-fb14e723a01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.223625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 777/1548] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.225348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870caa-ee9a-4866-823e-adada09be525 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.225638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870caa-ee9a-4866-823e-adada09be525 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.225920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42870caa-ee9a-4866-823e-adada09be525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.231470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 772/1549] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.234918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.245243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-42870caa-ee9a-4866-823e-adada09be525 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.246559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-42870caa-ee9a-4866-823e-adada09be525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.295878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67900e70-4654-487d-a48c-fa7f1453ff62 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.301137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4676b4f-80ba-4bc4-9517-dda443543233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.301795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676b4f-80ba-4bc4-9517-dda443543233 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.302077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676b4f-80ba-4bc4-9517-dda443543233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.302355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4676b4f-80ba-4bc4-9517-dda443543233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.303045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676b4f-80ba-4bc4-9517-dda443543233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.304971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4676b4f-80ba-4bc4-9517-dda443543233 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.307756 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 778/1550] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.309225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88689657-700d-4b91-8ca2-dde6569003c5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.309517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88689657-700d-4b91-8ca2-dde6569003c5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.309800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88689657-700d-4b91-8ca2-dde6569003c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.329504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-88689657-700d-4b91-8ca2-dde6569003c5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.330764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-88689657-700d-4b91-8ca2-dde6569003c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.331874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 773/1551] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.333097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2deb-77a9-47d1-a6ed-ce53279d03f0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.333393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2deb-77a9-47d1-a6ed-ce53279d03f0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.333674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2deb-77a9-47d1-a6ed-ce53279d03f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.351119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e12b2deb-77a9-47d1-a6ed-ce53279d03f0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.352267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e12b2deb-77a9-47d1-a6ed-ce53279d03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.391898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 779/1552] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.393211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e2d4-ccd0-4544-a5e8-43571a2f243c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.393525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e2d4-ccd0-4544-a5e8-43571a2f243c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.394054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e2d4-ccd0-4544-a5e8-43571a2f243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.411225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 774/1553] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.411438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-95e0e2d4-ccd0-4544-a5e8-43571a2f243c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.412533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.412645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-95e0e2d4-ccd0-4544-a5e8-43571a2f243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.412840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.413108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.420750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 780/1554] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.422017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.422312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.422593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.431287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.432509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.441139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.441610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 775/1555] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.442155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.442354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.452460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 781/1556] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.454037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.457195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e725b6-15d0-4ad1-8848-3703c61f1ffa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.461749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa31c8-4299-4166-aea7-8c2ec54e996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.462404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa31c8-4299-4166-aea7-8c2ec54e996b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.462686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa31c8-4299-4166-aea7-8c2ec54e996b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.462959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa31c8-4299-4166-aea7-8c2ec54e996b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.463643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa31c8-4299-4166-aea7-8c2ec54e996b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.463741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dc025-a641-4951-beea-f6d763cafea9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.465583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa31c8-4299-4166-aea7-8c2ec54e996b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.468394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.469028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.469311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.469593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.470593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.470907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.472515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.484726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 782/1557] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.486331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.487459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 776/1558] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.488876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.489164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.489444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.498001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15f8b8-094b-4cee-ad33-35b62c114a1a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.498304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.503415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.504128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.504418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.504691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.505406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.506436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:53:19.506436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:53:19.506436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:53:19.508140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938d393-2a0d-482f-806e-72795e15b280 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.512661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.514044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.526764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 777/1559] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.531603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.537453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 783/1560] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.537453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966a5d-de21-4bb4-bfdf-8ae2503b0f19 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.537453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966a5d-de21-4bb4-bfdf-8ae2503b0f19 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.537453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966a5d-de21-4bb4-bfdf-8ae2503b0f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.543415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb25f01-ddc3-48c7-8b91-77427162db57 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.548216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.548873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.549159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.549439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.550162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.550472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.552706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.554703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5e966a5d-de21-4bb4-bfdf-8ae2503b0f19 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.555899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5e966a5d-de21-4bb4-bfdf-8ae2503b0f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.564235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 784/1561] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.564475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 778/1562] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.565266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.565458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.565745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.566018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.576583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.577887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fc9e-7348-470e-955d-fa74be022b1e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.583698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.584647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.584934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.585214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.585989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.586300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.587999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.590661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.591861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.601309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 785/1563] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.601826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.604887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 779/1564] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.605720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.615951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fa98-e422-4ed9-8613-5a9f1c2fb773 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.616150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d0f9-3666-460b-b7a7-dfd4e65666d6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.620555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.620745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.621194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.621296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.621477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.621606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.621805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.621930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.622433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.622543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.624130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.624364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.635018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 786/1565] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:19.635703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.646238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228145-22e2-4efd-bd2d-e1f0cd8c46ad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.651684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.652373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.652661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.652970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.653693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.654009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.654152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 780/1566] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.655174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.655671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.668387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 787/1567] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.668387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.680890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab758-831c-45b9-80f8-864d61fce918 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.721221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c059bc-9a90-4a17-99fa-46ecc9d0adff admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.726105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.726770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.727053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.727329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.728051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.729674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.739458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.740130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.743257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 781/1568] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:19.743395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.743395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.743590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.743693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.743693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.743693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.752957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e828-b4af-4a1a-976f-d71a96292e35 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.762055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 788/1569] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.762055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.765133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.765283 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23808790-069a-4e93-a7b8-b6df7b6f3c72 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.765783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.766062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.766362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.767099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.769013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.769921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.770606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.770839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.771117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.771835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:19.772190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.773754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.786183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 789/1570] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:19.793446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.796574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4debc1-a196-46ec-ac3b-bd16c5c203ee admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.801849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.802480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.802767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.803042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.803717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.804913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 782/1571] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.805622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.809009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.832107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 790/1572] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.832529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.887074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa12ff-ef64-44b0-aa8d-8e3c9766b7ef admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.901494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc8e1-aa79-4288-a408-c04406055951 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.906299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.907081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.907881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.908251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.908963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.910869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.916651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.932381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 791/1573] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.933138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.942721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80b7fd-047f-4363-9f19-b6adc9361a23 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.947777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.948437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.948787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.948898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.949077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.949561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.949760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.949882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.950097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.950812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.951783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.952405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.962588 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 783/1574] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:19.963376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.973591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0807bd7-b137-4dcf-b627-bbe116b03189 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.974780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.979600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.980368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.980727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.981107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.981849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.982443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 792/1575] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:19.983463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.983621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.994237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 784/1576] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:19.995077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.006795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2cae-5ac6-4ace-9dbc-fba1128d564c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.052265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfe17-ef9c-4a1c-9f94-f6df9483927e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.057024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.057708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.058029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.058312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.059014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.060990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.067639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.068399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.068683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.068959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.069670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.071798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.089202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 793/1577] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.090036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.101671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 785/1578] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.102352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.154750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f0f6-c9a0-4f33-b12f-ae6d3d74ecdd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.159446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.160219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.160506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.160782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.161472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.163454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.167779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257cc48-f3b4-4934-8d3e-7234e99b1924 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.173761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.174438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.174716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.174989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.175808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.177932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.186505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 794/1579] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.188175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.200144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c59d-099d-42a7-a76c-5eea7e63c56a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.204127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 786/1580] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.204127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.207899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.208608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.208898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.209180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.209911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.211204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20178-ac47-45ad-aa9c-2236b8d5de6f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.211555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.215852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.216784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.217081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.217346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] PATH_INFO: `/v3/projects/851aeb41ae9f435ebb58910597f2afb0/users/85a7eecf9c5844fb9e070e5769f485df/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.222055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 795/1581] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.225194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.233361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851aeb41ae9f435ebb58910597f2afb0, user_id=85a7eecf9c5844fb9e070e5769f485df, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.234414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:53:20.234414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:53:20.234414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:53:20.235884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2eb1-64f8-4e55-be21-2562b2b590a4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.237111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.240620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.241464 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.241702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.241978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.242775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.244824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.251074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 787/1582] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/851aeb41ae9f435ebb58910597f2afb0/users/85a7eecf9c5844fb9e070e5769f485df/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.254222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.268049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.271863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 796/1583] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.272564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.282456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a18d7-a4cb-48d7-96d0-3c96cb9bb4e3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.326260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b200-366f-44d2-b347-4043ecd2f359 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.326568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.331321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.332471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.332788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.333102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] PATH_INFO: `/v3/projects/3ddd651f72c1466ca82870380628901b/users/5b0f08d6e4dc4d529ffade57cab8a0ed/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.340467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.341137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.341446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.341726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.342437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.344405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.348901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddd651f72c1466ca82870380628901b, user_id=5b0f08d6e4dc4d529ffade57cab8a0ed, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.351550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.365377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 788/1584] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/3ddd651f72c1466ca82870380628901b/users/5b0f08d6e4dc4d529ffade57cab8a0ed/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.365977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.366720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 797/1585] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.368933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.385331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d1f3f-8520-4258-9fcb-68cd1fe2bce7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.438941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3063b34-65eb-4a82-80b6-ed1ca6efb5c9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.443247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.443412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.443913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.444028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.444230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.444344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.444510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.444621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.445236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.445345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.447096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.447473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.457119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 798/1586] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.458294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.470968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 789/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.470968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.475277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5f42-1c87-4393-b77a-905934d3e462 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.480181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a446f-471e-410f-9bb8-a56dde08566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.481009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a446f-471e-410f-9bb8-a56dde08566f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.481361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a446f-471e-410f-9bb8-a56dde08566f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.481642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a446f-471e-410f-9bb8-a56dde08566f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.482367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a446f-471e-410f-9bb8-a56dde08566f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.482506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14b5a0-377b-4661-adc2-39e862cd8b31 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.483951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a446f-471e-410f-9bb8-a56dde08566f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.487189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.487876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.488216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.488523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.489281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.490849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.494088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 799/1588] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.498285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.498650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.498930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.502455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 790/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.503308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.512956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc149f-d47f-4abb-9ea9-1dff6fa6a737 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.518026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.518690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.519003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.519278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.520024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.521653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.529016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] MFA Rules not processed for user `85a7eecf9c5844fb9e070e5769f485df`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:20.530244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.531491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 791/1590] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.533505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.544113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3593e-fe42-4ce3-8dcd-707a7e4e2504 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.548762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6e48-9c52-471e-81d5-d2f79c08bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.549402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6e48-9c52-471e-81d5-d2f79c08bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.549687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6e48-9c52-471e-81d5-d2f79c08bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.549967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6e48-9c52-471e-81d5-d2f79c08bf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.550678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6e48-9c52-471e-81d5-d2f79c08bf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.552428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6e48-9c52-471e-81d5-d2f79c08bf75 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.562673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 792/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.564410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.564700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.564976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.590954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] MFA Rules not processed for user `5b0f08d6e4dc4d529ffade57cab8a0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:20.592424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.600046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 800/1592] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:20.600984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.611814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23abe96-4810-42ac-ba5d-6aae73e613a7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.616554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.617218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.617501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.617779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.618515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.620157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.635450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 801/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.636390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.637426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.649483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7805-0c28-4df2-ba56-0bf1ea00981b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.654528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.655191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.655478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.655754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.656529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.658183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.668353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 802/1594] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.669143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.676566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 793/1595] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:20.676566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.682372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54e630-14ba-47b7-b249-703220e1dcaf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.686205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffd25a-a232-48a4-aa2e-055f6710373e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.687649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.688876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.689217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.689444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.690321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.691789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.691965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.692696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.692978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.693254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] PATH_INFO: `/v3/projects/cde7d28ed0da4db7ad43eca04cdd6ad4/users/56793c62ca19479c81e56edc9a325a22/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.704028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 803/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.704959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.711466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde7d28ed0da4db7ad43eca04cdd6ad4, user_id=56793c62ca19479c81e56edc9a325a22, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.713750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.714738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaab5ad-adce-4c36-aa3b-7a1e334f45cd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.719886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca07ae7-5efe-47a5-911c-dfc71ad4e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.720652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca07ae7-5efe-47a5-911c-dfc71ad4e8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.721035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca07ae7-5efe-47a5-911c-dfc71ad4e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.721468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca07ae7-5efe-47a5-911c-dfc71ad4e8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.722400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca07ae7-5efe-47a5-911c-dfc71ad4e8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.723957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca07ae7-5efe-47a5-911c-dfc71ad4e8a0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.727295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 794/1597] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/cde7d28ed0da4db7ad43eca04cdd6ad4/users/56793c62ca19479c81e56edc9a325a22/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.728111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.743700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 804/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.745152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96343e-998d-4dcc-831a-58e8fe32146a None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.745511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96343e-998d-4dcc-831a-58e8fe32146a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.745874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96343e-998d-4dcc-831a-58e8fe32146a None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.747278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 805/1599] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 14 10:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:20.748088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96343e-998d-4dcc-831a-58e8fe32146a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.757644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.797650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d1ffe-208e-44ce-b0d5-484d25dd9975 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.802915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.803578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.803862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.804176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.804902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.806498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.815244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96343e-998d-4dcc-831a-58e8fe32146a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.820235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 795/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.820235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.822346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.823297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.823663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.823940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] PATH_INFO: `/v3/projects/533dfe17589b405ab48bf69eaefd4f2e/users/5147d665ec624416a87056fb249f06b1/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.828515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c170fda-21b8-4bf6-a414-01b5ae8e166d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.833879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.834567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.834869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.835151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.835872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.837495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.839593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=533dfe17589b405ab48bf69eaefd4f2e, user_id=5147d665ec624416a87056fb249f06b1, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.842497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.847858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 796/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.848709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.861101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 806/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/533dfe17589b405ab48bf69eaefd4f2e/users/5147d665ec624416a87056fb249f06b1/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.862098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.910652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9bf3-b513-4585-b5f5-d9902253fccf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.924421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5391fd-1809-4e01-b2f9-ff5635d9e71b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.929099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd98e1d-88df-402c-97a9-eeb855450d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.929984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98e1d-88df-402c-97a9-eeb855450d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.930269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98e1d-88df-402c-97a9-eeb855450d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.930551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98e1d-88df-402c-97a9-eeb855450d71 admin admin] PATH_INFO: `/v3/projects/3179b4cebcd8424a87bb62b4b8414bc2/users/df5446a1745d4fde8d036fa81deb0727/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.946511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd98e1d-88df-402c-97a9-eeb855450d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3179b4cebcd8424a87bb62b4b8414bc2, user_id=df5446a1745d4fde8d036fa81deb0727, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.949209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd98e1d-88df-402c-97a9-eeb855450d71 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.961680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.962335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.962620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.962783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 807/1603] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/3179b4cebcd8424a87bb62b4b8414bc2/users/df5446a1745d4fde8d036fa81deb0727/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.966614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.966745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299375fa-5230-425a-9204-40ed862a5e4d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.966745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299375fa-5230-425a-9204-40ed862a5e4d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.966745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299375fa-5230-425a-9204-40ed862a5e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.969417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.990821 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-299375fa-5230-425a-9204-40ed862a5e4d None None] MFA Rules not processed for user `56793c62ca19479c81e56edc9a325a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:20.992152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-299375fa-5230-425a-9204-40ed862a5e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.023281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.024754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.033724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 797/1604] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.034492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.044655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1f8d9-09d7-4b95-a513-7ceec4d9b2fc service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.057281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 808/1605] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.058677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.058973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.059257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.065487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.098899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.100602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.110721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.112138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.112888 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.113136 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] PATH_INFO: `/v3/projects/2f52b755c73141e2b930f6e3bcb57417/users/ca66097e2ccf4fbb865e6174573007a7/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.130917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f52b755c73141e2b930f6e3bcb57417, user_id=ca66097e2ccf4fbb865e6174573007a7, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.134027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.154613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 798/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:21 2022] PUT /identity/v3/projects/2f52b755c73141e2b930f6e3bcb57417/users/ca66097e2ccf4fbb865e6174573007a7/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:21.166695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.174511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 809/1607] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.175305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.186779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58635932-d5b3-4858-a91f-52c466eb7bf4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.243677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb933045-6d1b-4b92-8c3c-68436f19dfbb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.249474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7af991-6900-43eb-9ada-f56683c017c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.249663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29899e87-750f-461c-badf-bad5e4297535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.250368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7af991-6900-43eb-9ada-f56683c017c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.250650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7af991-6900-43eb-9ada-f56683c017c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.250794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899e87-750f-461c-badf-bad5e4297535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.251477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7af991-6900-43eb-9ada-f56683c017c9 admin admin] PATH_INFO: `/v3/projects/72c32088fd59410c8bd6ba9e896d046f/users/c6d14aec58b54f0ab7c744fc4afed7bc/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.252037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899e87-750f-461c-badf-bad5e4297535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.252474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899e87-750f-461c-badf-bad5e4297535 admin admin] PATH_INFO: `/v3/projects/707ee6fa31334e388c2a156220954b54/users/f9c66bf9125f45818c304b3f595f6211/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.270352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29899e87-750f-461c-badf-bad5e4297535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707ee6fa31334e388c2a156220954b54, user_id=f9c66bf9125f45818c304b3f595f6211, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.272006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7af991-6900-43eb-9ada-f56683c017c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c32088fd59410c8bd6ba9e896d046f, user_id=c6d14aec58b54f0ab7c744fc4afed7bc, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.273098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29899e87-750f-461c-badf-bad5e4297535 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.274816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7af991-6900-43eb-9ada-f56683c017c9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.289137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 810/1608] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:21 2022] PUT /identity/v3/projects/707ee6fa31334e388c2a156220954b54/users/f9c66bf9125f45818c304b3f595f6211/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:21.290742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b5bef-bb59-49f4-94e5-828e0f172f53 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.291081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b5bef-bb59-49f4-94e5-828e0f172f53 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.291404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b5bef-bb59-49f4-94e5-828e0f172f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.293490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 799/1609] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:21 2022] PUT /identity/v3/projects/72c32088fd59410c8bd6ba9e896d046f/users/c6d14aec58b54f0ab7c744fc4afed7bc/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:21.294783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.295073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.295353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.315884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4e7b5bef-bb59-49f4-94e5-828e0f172f53 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.316206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.317302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.317465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4e7b5bef-bb59-49f4-94e5-828e0f172f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.326798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.385930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 800/1610] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.386570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.392867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 811/1611] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.392867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e1942-0c1f-4768-9503-6d89ed08043b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.392867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e1942-0c1f-4768-9503-6d89ed08043b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.392867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e1942-0c1f-4768-9503-6d89ed08043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.396227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486af9b-519b-4dbc-92f5-60b24df145d8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.401400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.401577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.402527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.402814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.403200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.403901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.405958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.427827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-837e1942-0c1f-4768-9503-6d89ed08043b None None] MFA Rules not processed for user `ca66097e2ccf4fbb865e6174573007a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.429230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-837e1942-0c1f-4768-9503-6d89ed08043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.439412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 801/1612] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:21.439412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.512753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 812/1613] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.514478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982dccb-5605-4b3d-b694-196010ff10e0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.514778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982dccb-5605-4b3d-b694-196010ff10e0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.515060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982dccb-5605-4b3d-b694-196010ff10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.525148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a17603-4559-4147-a108-9418e3fde045 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.533880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.534648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.534773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7982dccb-5605-4b3d-b694-196010ff10e0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.535130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.535487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.537009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7982dccb-5605-4b3d-b694-196010ff10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.618724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.620420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.621628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 813/1614] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.623071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.623362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.623685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.644053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.644480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 802/1615] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.645543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.645675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.659125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 814/1616] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.659125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.706291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.735931 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c729f-35d7-4630-8868-e419958c6a3a service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.740187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.740840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.741221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.741506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.742259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7606-3fbb-4941-89ec-2809188b36f0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.746365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe31377-34f9-4283-8a35-4d45c887bb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.747045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe31377-34f9-4283-8a35-4d45c887bb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.747333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe31377-34f9-4283-8a35-4d45c887bb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.747610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe31377-34f9-4283-8a35-4d45c887bb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.753475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.754964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.759681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe31377-34f9-4283-8a35-4d45c887bb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.761850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe31377-34f9-4283-8a35-4d45c887bb54 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.768156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 803/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.768975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.779853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738a4cc-58ec-402d-ba41-f75d1f669b23 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.787921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.788124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 815/1618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.788245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.788245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.788245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.788717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.791069 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.803133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909fe5-bdee-49cf-92bb-eee04fa33ae1 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.803564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909fe5-bdee-49cf-92bb-eee04fa33ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.806500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909fe5-bdee-49cf-92bb-eee04fa33ae1 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.809850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 816/1619] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 14 10:53:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:21.810774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4909fe5-bdee-49cf-92bb-eee04fa33ae1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.825223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 804/1620] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:21.826366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.848744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff421-357b-432a-9d2a-d4ae4cf65b27 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.849248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4909fe5-bdee-49cf-92bb-eee04fa33ae1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.853645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef2751-4517-4a4c-b1ff-7ff156935084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.854666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.854986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef2751-4517-4a4c-b1ff-7ff156935084 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.855480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.855751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.855876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef2751-4517-4a4c-b1ff-7ff156935084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.856092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.856338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef2751-4517-4a4c-b1ff-7ff156935084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.879474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef2751-4517-4a4c-b1ff-7ff156935084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.880999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef2751-4517-4a4c-b1ff-7ff156935084 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.881280 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.882772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.893367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 805/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.894526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec1a4-082c-45c0-837d-91ef6f4a5cb0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.894906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec1a4-082c-45c0-837d-91ef6f4a5cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.895134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec1a4-082c-45c0-837d-91ef6f4a5cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.912018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 817/1622] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.912934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.918285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-16aec1a4-082c-45c0-837d-91ef6f4a5cb0 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.921422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-16aec1a4-082c-45c0-837d-91ef6f4a5cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.943541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816448-e780-4d91-93dd-9383f5c04087 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.950412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a382b85-c493-4afb-831d-25c510cf2336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.952127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 806/1623] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.952699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382b85-c493-4afb-831d-25c510cf2336 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.953194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382b85-c493-4afb-831d-25c510cf2336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.953702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382b85-c493-4afb-831d-25c510cf2336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.954680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae049-74de-4b67-90e4-45479de661eb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.954884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae049-74de-4b67-90e4-45479de661eb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.955187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae049-74de-4b67-90e4-45479de661eb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.956964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a382b85-c493-4afb-831d-25c510cf2336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.957276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 807/1624] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 14 10:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:21.958172 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dae049-74de-4b67-90e4-45479de661eb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.966281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a382b85-c493-4afb-831d-25c510cf2336 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.977984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dae049-74de-4b67-90e4-45479de661eb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.986134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.987177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 818/1625] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:21.987749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.988540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.989065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.989509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.990311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.990858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.022352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:22.031176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:22.033051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.061564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 819/1626] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:22.062573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.084308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9404c4-0072-43e2-bfe7-4ed5259f6a42 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.089295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.090445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.091356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.091639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.091781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.091916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] PATH_INFO: `/v3/projects/33b2411a13334cd0a9900ebb9b027e33/users/d75724fab3bd4fa283ee39a091764444/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.112592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b2411a13334cd0a9900ebb9b027e33, user_id=d75724fab3bd4fa283ee39a091764444, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.115304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.125356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 808/1627] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:22.129013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.134784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 820/1628] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:22 2022] PUT /identity/v3/projects/33b2411a13334cd0a9900ebb9b027e33/users/d75724fab3bd4fa283ee39a091764444/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:22.138589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.274132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64297-0f7a-4a73-b89f-3a2d6e1b1617 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.307949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d1d91-ac27-4ed3-8e69-8db3b7c3541c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.334970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.335674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.338362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.338669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.341325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.346810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.379147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 821/1629] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:22.380282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.403707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bb32d-3c22-4594-bd57-dd195fca2e11 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.410280 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ff36-28d3-4b23-8262-d86d2cde114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.411477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ff36-28d3-4b23-8262-d86d2cde114d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.411923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ff36-28d3-4b23-8262-d86d2cde114d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.412302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ff36-28d3-4b23-8262-d86d2cde114d admin admin] PATH_INFO: `/v3/projects/33b2411a13334cd0a9900ebb9b027e33/users/d75724fab3bd4fa283ee39a091764444/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.415817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ff36-28d3-4b23-8262-d86d2cde114d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b2411a13334cd0a9900ebb9b027e33, user_id=d75724fab3bd4fa283ee39a091764444, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.418969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ff36-28d3-4b23-8262-d86d2cde114d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.426748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:22.437394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 822/1630] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:22 2022] PUT /identity/v3/projects/33b2411a13334cd0a9900ebb9b027e33/users/d75724fab3bd4fa283ee39a091764444/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:22.439944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8231fa-1f4b-4109-92f2-6d17c1bedd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.442649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8231fa-1f4b-4109-92f2-6d17c1bedd22 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.443084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8231fa-1f4b-4109-92f2-6d17c1bedd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.443084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8231fa-1f4b-4109-92f2-6d17c1bedd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.448849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.449157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.449437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.507978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] MFA Rules not processed for user `d75724fab3bd4fa283ee39a091764444`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:22.509246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.578500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8231fa-1f4b-4109-92f2-6d17c1bedd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.579958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8231fa-1f4b-4109-92f2-6d17c1bedd22 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.595293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 809/1631] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:22.631655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 823/1632] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:22.645400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2952-12cf-4e93-918a-fa22aef11125 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.645767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2952-12cf-4e93-918a-fa22aef11125 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.646128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba2952-12cf-4e93-918a-fa22aef11125 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.647841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 810/1633] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 14 10:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:22.649577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.654437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.654809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.655165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.676463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:22.677336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.745276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:22.765191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbcf5b-dc76-44e4-8611-c5fdb3c75883 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.772505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.774249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.774891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.775238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.794524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.797603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.823140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 824/1634] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:22.829704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 811/1635] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:22.944241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.955307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b187e-685c-4e6c-bc9e-082f3cf2d7ce service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.959244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.960003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.960387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.960739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.972331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.973860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.989037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 825/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:23.172132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.185558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba29513-a0df-44fe-ae60-e22d8206ecd8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.195566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283cc6-0cf4-49fe-8c44-616e74347493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.196862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283cc6-0cf4-49fe-8c44-616e74347493 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.197560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283cc6-0cf4-49fe-8c44-616e74347493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.198061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283cc6-0cf4-49fe-8c44-616e74347493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.385151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283cc6-0cf4-49fe-8c44-616e74347493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.388394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283cc6-0cf4-49fe-8c44-616e74347493 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.412927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 812/1637] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:24.403432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.545067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649196-bd01-47d9-a4d4-a18c7d379026 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.560641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.561566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.561864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.562245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] PATH_INFO: `/v3/users/56793c62ca19479c81e56edc9a325a22` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.564050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56793c62ca19479c81e56edc9a325a22)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.568723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.742428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56793c62ca19479c81e56edc9a325a22'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.743682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56793c62ca19479c81e56edc9a325a22'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.778730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56793c62ca19479c81e56edc9a325a22'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.836633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56793c62ca19479c81e56edc9a325a22'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.878962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56793c62ca19479c81e56edc9a325a22'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.886240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 826/1638] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:24 2022] DELETE /identity/v3/users/56793c62ca19479c81e56edc9a325a22 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:24.891250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.892421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.892946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.940355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:24.941690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.963196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:25.060484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 813/1639] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:25.183762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.186283 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:25.305608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1da37-0efe-4b7c-8f6c-f62c30061707 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.311874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e74f7d-1cbb-4b44-b41f-71f0d0a7e986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.313016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74f7d-1cbb-4b44-b41f-71f0d0a7e986 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.313568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74f7d-1cbb-4b44-b41f-71f0d0a7e986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.314698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74f7d-1cbb-4b44-b41f-71f0d0a7e986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.324048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:25.337115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e74f7d-1cbb-4b44-b41f-71f0d0a7e986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.343427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e74f7d-1cbb-4b44-b41f-71f0d0a7e986 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.369596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 827/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:26.054874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.056383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.097963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531160-d686-48f3-b20c-84f2684ef1af None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.136679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.139051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.139410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.139916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] PATH_INFO: `/v3/users/85a7eecf9c5844fb9e070e5769f485df` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.148215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a7eecf9c5844fb9e070e5769f485df)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.149408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:53:26.149408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: warnings.warn(msg) Jul 14 10:53:26.149408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: Jul 14 10:53:26.152501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:26.427334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a7eecf9c5844fb9e070e5769f485df'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.428822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a7eecf9c5844fb9e070e5769f485df'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.483345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a7eecf9c5844fb9e070e5769f485df'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.499450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a7eecf9c5844fb9e070e5769f485df'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.511394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a7eecf9c5844fb9e070e5769f485df'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.521322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 814/1641] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:26 2022] DELETE /identity/v3/users/85a7eecf9c5844fb9e070e5769f485df => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:26.529130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.529626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.532003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.582494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:26.583991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.723142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 828/1642] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:26.775076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.778564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.923565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1379-a29b-41a4-b2ab-6eb600091251 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.928905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c073d-4079-4d08-8d00-7d92d50dfcfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.930638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c073d-4079-4d08-8d00-7d92d50dfcfc service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.930638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c073d-4079-4d08-8d00-7d92d50dfcfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.930638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c073d-4079-4d08-8d00-7d92d50dfcfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.995260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c073d-4079-4d08-8d00-7d92d50dfcfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.996438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c073d-4079-4d08-8d00-7d92d50dfcfc service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:27.022849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 815/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:28.020131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.021672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.046017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df281e2a-fa78-438e-b5dd-6d02bea0d78b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.068911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.070015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.070444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.070931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] PATH_INFO: `/v3/projects/851aeb41ae9f435ebb58910597f2afb0` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.074362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=851aeb41ae9f435ebb58910597f2afb0)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.075573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: WARNING py.warnings [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:53:28.075573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: warnings.warn(msg) Jul 14 10:53:28.075573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: Jul 14 10:53:28.081520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.252181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851aeb41ae9f435ebb58910597f2afb0', 'request_id': 'req-dc39bf7b-9115-419b-9121-f7e57be74e7f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.305003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851aeb41ae9f435ebb58910597f2afb0', 'request_id': 'req-dc39bf7b-9115-419b-9121-f7e57be74e7f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.330305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851aeb41ae9f435ebb58910597f2afb0', 'request_id': 'req-dc39bf7b-9115-419b-9121-f7e57be74e7f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.362010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] The token cache is being invalidate because project 851aeb41ae9f435ebb58910597f2afb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:28.363077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.365211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.370793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 829/1644] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:28 2022] DELETE /identity/v3/projects/851aeb41ae9f435ebb58910597f2afb0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:28.376716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46de8a-8da1-4ac8-a0d4-89392df409d9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.377218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46de8a-8da1-4ac8-a0d4-89392df409d9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.377402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46de8a-8da1-4ac8-a0d4-89392df409d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.440679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cc46de8a-8da1-4ac8-a0d4-89392df409d9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:28.456364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cc46de8a-8da1-4ac8-a0d4-89392df409d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.541476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:28.549500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.551086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.672587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 816/1645] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:28.674730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.677440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.677853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.730897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:28.738287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.771889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 817/1646] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:28.772963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.791306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39bf7b-9115-419b-9121-f7e57be74e7f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.811726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395a72-cede-4264-9fcc-91051ae977d2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.834438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.835535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.835980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.836508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] PATH_INFO: `/v3/projects/cde7d28ed0da4db7ad43eca04cdd6ad4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.838309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde7d28ed0da4db7ad43eca04cdd6ad4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.842745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.853622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.857023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.857808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.858312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.862946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:28.863644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.867917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.891950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 818/1647] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:28.896402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.911269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:28.939291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f2fb9-5aa9-4329-b884-cca0f5a6dd30 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.954719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde7d28ed0da4db7ad43eca04cdd6ad4', 'request_id': 'req-c16cedba-51bf-4ef8-a1e6-8215b7432dff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.961979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde7d28ed0da4db7ad43eca04cdd6ad4', 'request_id': 'req-c16cedba-51bf-4ef8-a1e6-8215b7432dff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.972372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde7d28ed0da4db7ad43eca04cdd6ad4', 'request_id': 'req-c16cedba-51bf-4ef8-a1e6-8215b7432dff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.992084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] The token cache is being invalidate because project cde7d28ed0da4db7ad43eca04cdd6ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:28.992443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.993211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.995144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 830/1648] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:28 2022] DELETE /identity/v3/projects/cde7d28ed0da4db7ad43eca04cdd6ad4 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:28.999331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.001697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.103875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cedba-51bf-4ef8-a1e6-8215b7432dff admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.112678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.113944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.113944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.114115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] PATH_INFO: `/v3/users/d75724fab3bd4fa283ee39a091764444` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.117083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75724fab3bd4fa283ee39a091764444)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.119045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.169114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.170181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.170674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.171157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.172092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.180407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.271150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 819/1649] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:28 2022] POST /identity/v3/projects => generated 355 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:29.275655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.282395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.286216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75724fab3bd4fa283ee39a091764444'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.287665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75724fab3bd4fa283ee39a091764444'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.350565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75724fab3bd4fa283ee39a091764444'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.386984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75724fab3bd4fa283ee39a091764444'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.403030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75724fab3bd4fa283ee39a091764444'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.418346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 831/1650] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:28 2022] DELETE /identity/v3/users/d75724fab3bd4fa283ee39a091764444 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:29.419970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.425383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.501956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c37240-d560-49ab-8f5f-4e4806e0c57e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.511466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:29.564742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f6ab7-d444-4728-a3de-b2d7708b33ef admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.570232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.571135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.571851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.572169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] PATH_INFO: `/v3/users/ca66097e2ccf4fbb865e6174573007a7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.574278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca66097e2ccf4fbb865e6174573007a7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.576328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.635884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:29.667788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.668585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.668875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.669156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.671287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.680510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.697619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca66097e2ccf4fbb865e6174573007a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.698997 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca66097e2ccf4fbb865e6174573007a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.717698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 820/1651] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/users => generated 278 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:29.721871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.725617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.741212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca66097e2ccf4fbb865e6174573007a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.755176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5a414-6e65-457c-8a50-d92b0efd5684 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.762050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca66097e2ccf4fbb865e6174573007a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.771815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.772588 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.772875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.773202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.773958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.780461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.781944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-331ac994-7c36-4766-adde-73b81363d719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca66097e2ccf4fbb865e6174573007a7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.800849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 832/1652] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:29 2022] DELETE /identity/v3/users/ca66097e2ccf4fbb865e6174573007a7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:29.806030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.806320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.806603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.812149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 821/1653] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:29.816485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.842794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094c43c-808a-4965-8072-14842a0510a8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.851210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:29.856768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:30.010252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.010963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.011253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.011534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.014502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.018850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.046698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 822/1654] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:30.051085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:30.079554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473141-9ebc-4f8c-ae00-73f9469b8196 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.079867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 833/1655] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:30.100236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfa0d9-6a58-4d11-9aa3-0018f41ae854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.101290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa0d9-6a58-4d11-9aa3-0018f41ae854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.101662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa0d9-6a58-4d11-9aa3-0018f41ae854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.101969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa0d9-6a58-4d11-9aa3-0018f41ae854 admin admin] PATH_INFO: `/v3/projects/21167cd9ea7e45359f830585ccbc4c76/users/d6e26d2ac011437aa77709328c70a6d6/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.113773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:30.115349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:30.161855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfa0d9-6a58-4d11-9aa3-0018f41ae854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21167cd9ea7e45359f830585ccbc4c76, user_id=d6e26d2ac011437aa77709328c70a6d6, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.165232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfa0d9-6a58-4d11-9aa3-0018f41ae854 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.196663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 823/1656] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:30 2022] PUT /identity/v3/projects/21167cd9ea7e45359f830585ccbc4c76/users/d6e26d2ac011437aa77709328c70a6d6/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:30.208516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.208806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.209237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.289301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] MFA Rules not processed for user `d6e26d2ac011437aa77709328c70a6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:30.290883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:30.292152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:30.299925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59935f3c-d2d6-4c5d-8a09-bab7cc0cdddd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.411176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.411683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.411986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.412273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.479007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 824/1657] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:30.483449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:30.568708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:30.598912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.602557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.650621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607cc49-b8fa-4664-a9a1-b559e98a9995 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.655442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 834/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:30.667608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.668412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.668603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.668886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.669600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.671526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.727341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 825/1659] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:30 2022] POST /identity/v3/projects => generated 357 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:30.732458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:30.748714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea2afb-177b-4fbf-9ef7-08bc7aab663d service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.928423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.929173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.929398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.929669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.930790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.932331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.982600 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 835/1660] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:30 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:30.986448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.012391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a8252-0e18-481f-855a-f830d822c48b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.029382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.030399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.030737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.031118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.036711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.038090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.072384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 826/1661] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:31.076656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.097094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a6de-1f4e-4212-b747-d01b68b232d3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.125299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.129081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.129681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.131051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] PATH_INFO: `/v3/projects/356f03632a3d4782a1c1eeaf3af1a3bd/users/62f1564e0314418aa39d508c15579306/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.179359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356f03632a3d4782a1c1eeaf3af1a3bd, user_id=62f1564e0314418aa39d508c15579306, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.188575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.223445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 836/1662] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:31 2022] PUT /identity/v3/projects/356f03632a3d4782a1c1eeaf3af1a3bd/users/62f1564e0314418aa39d508c15579306/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:31.229806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.231732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.237568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.269297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5221b5-195c-400f-8603-cf65d880b539 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.305281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:31.416432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ade3bd-c46e-439f-8fb9-146f2ce2d176 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.424001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d264c5-d1d0-4fb8-82cf-e6f986def11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.426044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d264c5-d1d0-4fb8-82cf-e6f986def11d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.427091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d264c5-d1d0-4fb8-82cf-e6f986def11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.427633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d264c5-d1d0-4fb8-82cf-e6f986def11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.429853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d264c5-d1d0-4fb8-82cf-e6f986def11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.434072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d264c5-d1d0-4fb8-82cf-e6f986def11d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.457111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.458346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.458770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.459186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] PATH_INFO: `/v3/projects/33b2411a13334cd0a9900ebb9b027e33` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.467537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 837/1663] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:31.469172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.469659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.470918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.476739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b2411a13334cd0a9900ebb9b027e33)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.482156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.504530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] MFA Rules not processed for user `df5446a1745d4fde8d036fa81deb0727`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:31.506169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.586668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b2411a13334cd0a9900ebb9b027e33', 'request_id': 'req-bb64024d-eda8-4b55-81a4-40c362da88d1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.596714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b2411a13334cd0a9900ebb9b027e33', 'request_id': 'req-bb64024d-eda8-4b55-81a4-40c362da88d1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.624344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 838/1664] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:31.624344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.634913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b2411a13334cd0a9900ebb9b027e33', 'request_id': 'req-bb64024d-eda8-4b55-81a4-40c362da88d1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.639448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097692e8-b809-43ed-8c05-89c32793a925 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.658767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] The token cache is being invalidate because project 33b2411a13334cd0a9900ebb9b027e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:31.659390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.660258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.662278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 827/1665] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:31 2022] DELETE /identity/v3/projects/33b2411a13334cd0a9900ebb9b027e33 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:31.663806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.669153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.723023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748dbf0-8b46-4f6d-883f-83aa1855b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.724176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748dbf0-8b46-4f6d-883f-83aa1855b549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.724560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748dbf0-8b46-4f6d-883f-83aa1855b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.724930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748dbf0-8b46-4f6d-883f-83aa1855b549 admin admin] PATH_INFO: `/v3/projects/356f03632a3d4782a1c1eeaf3af1a3bd/users/62f1564e0314418aa39d508c15579306/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.727121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748dbf0-8b46-4f6d-883f-83aa1855b549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356f03632a3d4782a1c1eeaf3af1a3bd, user_id=62f1564e0314418aa39d508c15579306, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.730595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748dbf0-8b46-4f6d-883f-83aa1855b549 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.755664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 839/1666] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:31 2022] PUT /identity/v3/projects/356f03632a3d4782a1c1eeaf3af1a3bd/users/62f1564e0314418aa39d508c15579306/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:31.755664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229052-cbd9-433b-87ca-8f747ef365ad None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.755664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229052-cbd9-433b-87ca-8f747ef365ad None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.755664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229052-cbd9-433b-87ca-8f747ef365ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.757480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:31.786811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-94229052-cbd9-433b-87ca-8f747ef365ad None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:31.788041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-94229052-cbd9-433b-87ca-8f747ef365ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.824169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64024d-eda8-4b55-81a4-40c362da88d1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.841343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:31.905203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.907236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.907236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.907886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.910611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.991164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 840/1667] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:31.992961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.994118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.994609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.017261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.018981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8187-524f-46fb-a4c3-7a103aa243d0 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.030749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 828/1668] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:32.032481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.032481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.032790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.053595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:32.054992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.064481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 829/1669] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:32.068511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.079314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f409b-059d-4adb-a61b-b19478a6774d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.085750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.086645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.086999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.087348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.088264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:32.088546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.090757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.108311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 830/1670] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:32.114470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.136373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226645d5-311e-46f3-94d3-a326aad2f211 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.143512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.146243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.146530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.147045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.147765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.152995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.162980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] MFA Rules not processed for user `62f1564e0314418aa39d508c15579306`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:32.166198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.203156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 831/1671] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:32.203156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.248930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:32.325258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48c4f-b914-41cc-994d-b900b70a2217 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.337229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.337937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.339057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.339631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.343550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.345663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.367930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 841/1672] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:32.380431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.382038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.404054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 832/1673] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:32.405577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.420724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc6bff-ba67-4474-a319-444888a24cf2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.427836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.430199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.431126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.431899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.433842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.441987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.461796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 833/1674] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:32.463178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.498060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c20a-3940-4eaf-b49e-f4834c7c4fd8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.507552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.508361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.509736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.510944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.512617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.519737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.536027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 834/1675] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:32.537643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.540207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.541408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a2c6f-c903-4107-aff4-a9d93c3d2a7e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.574416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e663dab-c634-45d1-a0b1-4000eed5bac4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.582272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.585018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.585527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.585968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] PATH_INFO: `/v3/projects/2f52b755c73141e2b930f6e3bcb57417` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.587517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f52b755c73141e2b930f6e3bcb57417)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.590599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.685800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f52b755c73141e2b930f6e3bcb57417', 'request_id': 'req-63020317-1523-4271-97b8-3042fe9cd4f4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.698642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f52b755c73141e2b930f6e3bcb57417', 'request_id': 'req-63020317-1523-4271-97b8-3042fe9cd4f4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.712110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f52b755c73141e2b930f6e3bcb57417', 'request_id': 'req-63020317-1523-4271-97b8-3042fe9cd4f4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.715160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c65f1e-b242-407d-bd1b-54eb507519a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.715850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c65f1e-b242-407d-bd1b-54eb507519a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.718053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c65f1e-b242-407d-bd1b-54eb507519a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.718370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c65f1e-b242-407d-bd1b-54eb507519a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.731482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] The token cache is being invalidate because project 2f52b755c73141e2b930f6e3bcb57417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:32.732005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.734257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.736809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 835/1676] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:32 2022] DELETE /identity/v3/projects/2f52b755c73141e2b930f6e3bcb57417 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:32.740205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.740205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.820869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:32.908996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c65f1e-b242-407d-bd1b-54eb507519a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.910901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c65f1e-b242-407d-bd1b-54eb507519a1 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.915062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63020317-1523-4271-97b8-3042fe9cd4f4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.930272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d79e-7d6c-4248-aec7-388fa30ba3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.935138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d79e-7d6c-4248-aec7-388fa30ba3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.936002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d79e-7d6c-4248-aec7-388fa30ba3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.936377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d79e-7d6c-4248-aec7-388fa30ba3f6 admin admin] PATH_INFO: `/v3/projects/fb43600733894299b4995f08fb448da8/users/85305b83f0b748e289f6776c489d54eb/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.937142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 842/1677] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:32.962861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.963204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.963840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.990277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d79e-7d6c-4248-aec7-388fa30ba3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb43600733894299b4995f08fb448da8, user_id=85305b83f0b748e289f6776c489d54eb, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.998289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d79e-7d6c-4248-aec7-388fa30ba3f6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.028511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:33.034942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:33.035475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.052724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 836/1678] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:32 2022] PUT /identity/v3/projects/fb43600733894299b4995f08fb448da8/users/85305b83f0b748e289f6776c489d54eb/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:33.070489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c528-8a0e-4a1e-8f7d-7ae4ff8737db None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.071082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c528-8a0e-4a1e-8f7d-7ae4ff8737db None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.072088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c528-8a0e-4a1e-8f7d-7ae4ff8737db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.154955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dac8c528-8a0e-4a1e-8f7d-7ae4ff8737db None None] MFA Rules not processed for user `85305b83f0b748e289f6776c489d54eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:33.158894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dac8c528-8a0e-4a1e-8f7d-7ae4ff8737db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.184855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 843/1679] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:33.185850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.189141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.327933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 837/1680] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:33.329495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.329891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.330285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.365214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90203570-b132-4fff-b73b-8f51925b8397 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.373665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:33.376853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.377539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.377824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.378102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.378647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.383496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.419137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 838/1681] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:33.419851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.456744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e9fee-322f-4b32-b568-e4fdeddfbda5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.467878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.470033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.470303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.471766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.472550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.479969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.551533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 839/1682] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:33.551533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.573000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.574804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.599639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 844/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:33.615094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.665736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef358-f33c-4171-98c6-b85a63a6a5ca service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.749483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:33.768924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570fa90-be47-4ffd-b027-13c1229f24b1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.785903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.786461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.790579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.791801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.792990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:33.793314 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.804481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.844131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 840/1684] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:33.845638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.851220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.852151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.854236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.854555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.854861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.857787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.864573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.885613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc0fe-c401-4b08-85a2-fae580aceab4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.901747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.904646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.904940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.905271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] PATH_INFO: `/v3/users/5b0f08d6e4dc4d529ffade57cab8a0ed` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.907506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0f08d6e4dc4d529ffade57cab8a0ed)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.913713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 845/1685] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:33.915838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.916378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.942376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdf16d-2f2c-44bf-9469-16f9cf3dbab5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.957153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.959992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.961736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.965648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.966325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.973004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.068613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0f08d6e4dc4d529ffade57cab8a0ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.069366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0f08d6e4dc4d529ffade57cab8a0ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.069758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 846/1686] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:34.074963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.077957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.083635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.107829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0f08d6e4dc4d529ffade57cab8a0ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.131361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0f08d6e4dc4d529ffade57cab8a0ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.160599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0f08d6e4dc4d529ffade57cab8a0ed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.175792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 841/1687] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:33 2022] DELETE /identity/v3/users/5b0f08d6e4dc4d529ffade57cab8a0ed => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.175792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.179031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.272972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438757-f2f2-4798-93e8-960ca0b6bee6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.342710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787ba4-64f7-49f7-b490-ea9dbb16b3a8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.351442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88500-1ebe-4525-9ccb-d2268e23a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.351442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88500-1ebe-4525-9ccb-d2268e23a768 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.351442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88500-1ebe-4525-9ccb-d2268e23a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.351722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88500-1ebe-4525-9ccb-d2268e23a768 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.352463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88500-1ebe-4525-9ccb-d2268e23a768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.354530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88500-1ebe-4525-9ccb-d2268e23a768 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.401186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.402040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.402269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.402591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.403360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.405144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.406368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 842/1688] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:34 2022] POST /identity/v3/users => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:34.410464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.410598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.410883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.423861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 847/1689] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:34.425999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.448585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:34.449755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.459957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e4e50-a54b-4bed-ab68-edac55905ba6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.464025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 843/1690] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:34.464667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.473258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.476372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.476939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.477861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73183b14-ca44-4b6e-9f60-dd61941544c6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.478445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.481533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.485751 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.492041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.496902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.497190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.497468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] PATH_INFO: `/v3/projects/254a54cd3cc44bc7808707c9549b80fb/users/9a53472d53004bf687414253ad728375/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.513980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 848/1691] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:34.514871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.518374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.522328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254a54cd3cc44bc7808707c9549b80fb, user_id=9a53472d53004bf687414253ad728375, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.525753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.550040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 844/1692] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:34 2022] PUT /identity/v3/projects/254a54cd3cc44bc7808707c9549b80fb/users/9a53472d53004bf687414253ad728375/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.552616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eee09-2cf3-477f-8fb5-34960769ef0f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.556009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.631883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.684306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.685407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.685695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.685974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] PATH_INFO: `/v3/users/d6e26d2ac011437aa77709328c70a6d6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.687291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e26d2ac011437aa77709328c70a6d6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.690073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.703396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ebad-fda9-4d8c-a53a-648ad44b0a22 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.720326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.721652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.721940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.723471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.725608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.730766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.755038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e26d2ac011437aa77709328c70a6d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.761891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 845/1693] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:34.762856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.767668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e26d2ac011437aa77709328c70a6d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.768097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.805005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cfa0b-e433-459b-9d30-e651e0df9bdc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.814103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.815165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.815671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.816145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.817302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.819235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.827291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e26d2ac011437aa77709328c70a6d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.845663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 846/1694] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:34.846886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.850753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e26d2ac011437aa77709328c70a6d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.852439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.870371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e26d2ac011437aa77709328c70a6d6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.879374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.880873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 849/1695] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:34 2022] DELETE /identity/v3/users/d6e26d2ac011437aa77709328c70a6d6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.882050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.887379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.998004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225449bb-758b-4161-9cf9-161884580ca1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.053641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17ab64-1ad4-47ae-8974-ce43229b3342 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.064056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.068834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.069078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.069366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] PATH_INFO: `/v3/projects/6d43a2c49bd34d549c967d2051a56be2/users/4fc783884eed493d9aea53a6c5768eb9/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.105478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d43a2c49bd34d549c967d2051a56be2, user_id=4fc783884eed493d9aea53a6c5768eb9, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.106308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.109661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.110310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.110493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.110759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.116587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.141729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.142712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 850/1696] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:34 2022] PUT /identity/v3/projects/6d43a2c49bd34d549c967d2051a56be2/users/4fc783884eed493d9aea53a6c5768eb9/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:35.143069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.152813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9f03a-c845-4d78-aa23-24bc9575770b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.165231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 847/1697] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:35.166566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc6fe-8400-4078-b693-d7543eebc97d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.166853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc6fe-8400-4078-b693-d7543eebc97d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.167130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc6fe-8400-4078-b693-d7543eebc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.189188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-47ebc6fe-8400-4078-b693-d7543eebc97d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.190418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-47ebc6fe-8400-4078-b693-d7543eebc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.217333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:35.278829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce085d-d104-40da-bc7f-6020427b18e1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.284357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac948e4-5a99-4352-a159-9b84493e1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.285273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac948e4-5a99-4352-a159-9b84493e1d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.285614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac948e4-5a99-4352-a159-9b84493e1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.285938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac948e4-5a99-4352-a159-9b84493e1d52 admin admin] PATH_INFO: `/v3/projects/254a54cd3cc44bc7808707c9549b80fb/users/9a53472d53004bf687414253ad728375/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.288926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac948e4-5a99-4352-a159-9b84493e1d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254a54cd3cc44bc7808707c9549b80fb, user_id=9a53472d53004bf687414253ad728375, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.294755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac948e4-5a99-4352-a159-9b84493e1d52 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.313039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 848/1698] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.314687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.315491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.315491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.329105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 851/1699] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:35 2022] PUT /identity/v3/projects/254a54cd3cc44bc7808707c9549b80fb/users/9a53472d53004bf687414253ad728375/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:35.340093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.340396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.340691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.388698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] MFA Rules not processed for user `4fc783884eed493d9aea53a6c5768eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.394248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.407483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] MFA Rules not processed for user `9a53472d53004bf687414253ad728375`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.412822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.569479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:35.580797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 849/1700] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.582106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.615890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 852/1701] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.616828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.664886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f7440-7bd4-43f4-9b1e-45d738723faa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.670757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.671443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.673495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.673778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.806920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14cbc2-c876-4259-a491-800f75e2d570 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.820758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.822406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.823321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.823608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.825594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.830623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.832585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.834190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.851827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 850/1702] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:35.852939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.854543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.890012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 853/1703] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/projects => generated 405 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:35.895169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.961892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96030-61df-4b17-9fe0-ee0cce109a39 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.994493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:36.038000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.039108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.039555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.039983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.061206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d9d68-aa20-4277-93dd-2a859653ab1c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.074372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.075009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.075251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.075530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.076260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.080285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:36.084883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.138596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 854/1704] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:36.140917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.152363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aaa8c-9f64-41c1-a9af-60d4dd692845 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.158597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.160688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.161067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.162276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.162524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.166317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.184100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 855/1705] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:36.185347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.195959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.197894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.200672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc01b0-a928-4ba5-9583-0221139eab54 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.209717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.211025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.211217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.212433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] PATH_INFO: `/v3/projects/e533743a5de84396b13085f81b16b17b/users/c31a99709abc4518a5148aeaf4cd05f6/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.233428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e533743a5de84396b13085f81b16b17b, user_id=c31a99709abc4518a5148aeaf4cd05f6, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.236202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 851/1706] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:36.236399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.256466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 856/1707] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:36 2022] PUT /identity/v3/projects/e533743a5de84396b13085f81b16b17b/users/c31a99709abc4518a5148aeaf4cd05f6/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:36.258452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.276094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.289560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3d7b-d8e6-4849-b12a-72de04fa6950 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.417933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76228d-9be0-4ed5-a771-38cf50eaf289 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.426197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.427800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.427941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.428981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.430450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.431721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.432998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.433381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.435308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.435761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] PATH_INFO: `/v3/users/85305b83f0b748e289f6776c489d54eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.437396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85305b83f0b748e289f6776c489d54eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.441331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.470524 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 852/1708] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:36.471453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.493743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d23a-b24a-40cb-8d45-23e22ef64e8d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.503337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136d2f-6291-41e6-b8ea-7a66a0ef2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.504280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136d2f-6291-41e6-b8ea-7a66a0ef2e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.504561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136d2f-6291-41e6-b8ea-7a66a0ef2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.504845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136d2f-6291-41e6-b8ea-7a66a0ef2e2b admin admin] PATH_INFO: `/v3/projects/e533743a5de84396b13085f81b16b17b/users/c31a99709abc4518a5148aeaf4cd05f6/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.507750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136d2f-6291-41e6-b8ea-7a66a0ef2e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e533743a5de84396b13085f81b16b17b, user_id=c31a99709abc4518a5148aeaf4cd05f6, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.514352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136d2f-6291-41e6-b8ea-7a66a0ef2e2b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.543340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85305b83f0b748e289f6776c489d54eb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.546223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85305b83f0b748e289f6776c489d54eb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.560290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 853/1709] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:36 2022] PUT /identity/v3/projects/e533743a5de84396b13085f81b16b17b/users/c31a99709abc4518a5148aeaf4cd05f6/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:36.563566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.563861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.564179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.588415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85305b83f0b748e289f6776c489d54eb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.605823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85305b83f0b748e289f6776c489d54eb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.627395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a078ebf-817c-4d14-b905-dab8dccd414e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85305b83f0b748e289f6776c489d54eb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.631375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] MFA Rules not processed for user `c31a99709abc4518a5148aeaf4cd05f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:36.632730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.640622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 857/1710] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:36 2022] DELETE /identity/v3/users/85305b83f0b748e289f6776c489d54eb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:36.644619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.645080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.645521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.676089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:36.695246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:36.697045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.803906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 854/1711] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:36.816251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.817995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.843650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 858/1712] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:36.867402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.869080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.887624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:37.001854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8ee6-9cc9-4bdd-8fda-3b708af46658 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.035314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e4e5-b25d-4e8a-8a34-0ecf7346b3ad None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.061371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.062823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.063119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.063396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.103527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.108287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.140600 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 859/1713] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:37.141597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.145931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.193857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e362f74-96d4-4d49-995f-2f54fe366abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.194822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e362f74-96d4-4d49-995f-2f54fe366abf service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.195105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e362f74-96d4-4d49-995f-2f54fe366abf service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.195395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e362f74-96d4-4d49-995f-2f54fe366abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.207264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a555-20aa-4b3f-99fb-233bea38ef50 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.220372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.222198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.222488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.222770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] PATH_INFO: `/v3/projects/3ddd651f72c1466ca82870380628901b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.226123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddd651f72c1466ca82870380628901b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.229140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.354971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e362f74-96d4-4d49-995f-2f54fe366abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.358639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e362f74-96d4-4d49-995f-2f54fe366abf service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.364831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddd651f72c1466ca82870380628901b', 'request_id': 'req-07067322-c09b-4816-9515-76ad2894679a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.375081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 855/1714] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:37.376468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddd651f72c1466ca82870380628901b', 'request_id': 'req-07067322-c09b-4816-9515-76ad2894679a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.396255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddd651f72c1466ca82870380628901b', 'request_id': 'req-07067322-c09b-4816-9515-76ad2894679a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.453368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] The token cache is being invalidate because project 3ddd651f72c1466ca82870380628901b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:37.454825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.455664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.470910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 860/1715] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/projects/3ddd651f72c1466ca82870380628901b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:37.472527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf78c9-310b-40e7-82c4-a142a45cd4db None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.472879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf78c9-310b-40e7-82c4-a142a45cd4db None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.473167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf78c9-310b-40e7-82c4-a142a45cd4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.537875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7dbf78c9-310b-40e7-82c4-a142a45cd4db None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:37.543882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7dbf78c9-310b-40e7-82c4-a142a45cd4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.668966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.672379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.730337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 856/1716] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:37.732691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.732957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.733230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.774909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:37.776267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.816098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 857/1717] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:37.817215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.835525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:37.843417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088ac67-9c17-4c63-9e83-d505c2fdbe23 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.867244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.867923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.868253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.868528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.869614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:37.869614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.871211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.922517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 858/1718] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:53:37.926019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.930984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.948883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067322-c09b-4816-9515-76ad2894679a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.960440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccf836-b292-4d23-b62a-ed2c0f7b4f6d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.971237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.972482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.976193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.977438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] PATH_INFO: `/v3/users/4fc783884eed493d9aea53a6c5768eb9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.979688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.980667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc783884eed493d9aea53a6c5768eb9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.981623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.984528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.985833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] PATH_INFO: `/v3/projects/21167cd9ea7e45359f830585ccbc4c76` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.986617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.990282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21167cd9ea7e45359f830585ccbc4c76)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.996994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.019260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:38.134132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc783884eed493d9aea53a6c5768eb9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.139051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc783884eed493d9aea53a6c5768eb9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.169147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21167cd9ea7e45359f830585ccbc4c76', 'request_id': 'req-9d920520-01d0-432a-918c-cadf76a220f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.180092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc783884eed493d9aea53a6c5768eb9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.189024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21167cd9ea7e45359f830585ccbc4c76', 'request_id': 'req-9d920520-01d0-432a-918c-cadf76a220f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.201037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc783884eed493d9aea53a6c5768eb9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.206500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21167cd9ea7e45359f830585ccbc4c76', 'request_id': 'req-9d920520-01d0-432a-918c-cadf76a220f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.221294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc783884eed493d9aea53a6c5768eb9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.241734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] The token cache is being invalidate because project 21167cd9ea7e45359f830585ccbc4c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:38.242036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.243243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 861/1719] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/users/4fc783884eed493d9aea53a6c5768eb9 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:38.243960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9d920520-01d0-432a-918c-cadf76a220f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.246996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.249238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 859/1720] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/projects/21167cd9ea7e45359f830585ccbc4c76 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:38.253458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.254949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.255245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.255533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.310574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:38.314275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.482473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e50d03-e3ed-4cd2-ad2f-43a2b1edc1d0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.498966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 860/1721] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:38.499797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.509775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.517042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.517801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.518167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.518513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.519277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.521330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.533447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb752aa-ac67-4372-8760-af754fda494e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.554414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.554690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.554978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.555309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] PATH_INFO: `/v3/users/62f1564e0314418aa39d508c15579306` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.566977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f1564e0314418aa39d508c15579306)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.569561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.608531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 862/1722] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/projects => generated 405 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:38.609506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.617437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.741273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f1564e0314418aa39d508c15579306'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.745261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f1564e0314418aa39d508c15579306'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.773318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f1564e0314418aa39d508c15579306'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.786186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f1564e0314418aa39d508c15579306'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.786787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:38.811672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f1564e0314418aa39d508c15579306'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.818887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 861/1723] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:38 2022] DELETE /identity/v3/users/62f1564e0314418aa39d508c15579306 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:38.823178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.829539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.850511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cba81-a7f7-4bd8-a0bd-928c44dc37dd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.860633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:38.981047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771827d-681f-4aef-9bdc-6b0040d77504 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.984912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.985738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.987678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b708818-a9bd-4a30-8e91-c3883cc028d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.988246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.988541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.989004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b708818-a9bd-4a30-8e91-c3883cc028d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.989540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b708818-a9bd-4a30-8e91-c3883cc028d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.989944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b708818-a9bd-4a30-8e91-c3883cc028d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.990863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b708818-a9bd-4a30-8e91-c3883cc028d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.999174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.999952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b708818-a9bd-4a30-8e91-c3883cc028d6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.040888 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 862/1724] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/users => generated 303 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.041348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945360c9-b830-4d95-bf10-e089ae55b928 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.041808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945360c9-b830-4d95-bf10-e089ae55b928 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.042194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945360c9-b830-4d95-bf10-e089ae55b928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.055438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.056944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.075967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-945360c9-b830-4d95-bf10-e089ae55b928 None None] MFA Rules not processed for user `c6d14aec58b54f0ab7c744fc4afed7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:39.079556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-945360c9-b830-4d95-bf10-e089ae55b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.086680 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 863/1725] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:39.087487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.109241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca130-2c56-4175-96da-abdddb3ce4d7 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.126917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.127682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.127896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.128219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.129485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.131118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.167743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 864/1726] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:39.169289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.192760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88eff2-3134-4ab4-a5df-9ade34c8b08d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.215180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 863/1727] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.218062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.218742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.219066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.219344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.220575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.220886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.221331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.222910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.224998 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.249077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] MFA Rules not processed for user `c6d14aec58b54f0ab7c744fc4afed7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:39.251342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.258913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 865/1728] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:39.265757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 864/1729] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.271899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.273777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.275747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.292931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412baecc-5732-4c8c-85dd-64b945d41349 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.309386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a95890-7aed-4c5d-83bc-4a535639695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.310446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a95890-7aed-4c5d-83bc-4a535639695a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.310733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a95890-7aed-4c5d-83bc-4a535639695a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.311014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a95890-7aed-4c5d-83bc-4a535639695a admin admin] PATH_INFO: `/v3/projects/f503993e700647f2aba5f1d9068b6737/users/e1ab1b7c858d4d269d0079a12984f96c/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.359207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a95890-7aed-4c5d-83bc-4a535639695a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f503993e700647f2aba5f1d9068b6737, user_id=e1ab1b7c858d4d269d0079a12984f96c, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.363749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a95890-7aed-4c5d-83bc-4a535639695a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.411608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 866/1730] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:39 2022] PUT /identity/v3/projects/f503993e700647f2aba5f1d9068b6737/users/e1ab1b7c858d4d269d0079a12984f96c/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:39.417944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.418444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.418582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.436205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f4aa-b0e9-4164-b9d2-2dc5f6469c55 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.465817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:39.466040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:39.467668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.593701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.594388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.594676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.594966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.595504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 867/1731] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.660101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.661871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.777750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.779433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.803520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 865/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:39.840167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08619c3-ba57-4478-80e9-33d7781f2de5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.844684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.845367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.845689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.846015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.859115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:39.869609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.874357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.896878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 868/1733] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:40.030152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.032238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.061991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ac0ce-7f94-4348-aec5-d4a93025fe3f service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.075765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.076726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.077007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.077282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] PATH_INFO: `/v3/projects/356f03632a3d4782a1c1eeaf3af1a3bd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.082695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=356f03632a3d4782a1c1eeaf3af1a3bd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.088251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.221374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356f03632a3d4782a1c1eeaf3af1a3bd', 'request_id': 'req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.237908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356f03632a3d4782a1c1eeaf3af1a3bd', 'request_id': 'req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.272456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356f03632a3d4782a1c1eeaf3af1a3bd', 'request_id': 'req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.284923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.286482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.317140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfa4c8-7aa5-40f5-8e4c-36461849b13d service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.325176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] The token cache is being invalidate because project 356f03632a3d4782a1c1eeaf3af1a3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:40.327567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.330640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d496956a-9c87-4d8e-9ac9-9668bf30ce6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.336363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 866/1734] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:40 2022] DELETE /identity/v3/projects/356f03632a3d4782a1c1eeaf3af1a3bd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:40.343024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902c13-d90e-478b-8602-d96af5cca188 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.343304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902c13-d90e-478b-8602-d96af5cca188 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.343580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902c13-d90e-478b-8602-d96af5cca188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.426424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d9902c13-d90e-478b-8602-d96af5cca188 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:40.427882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9902c13-d90e-478b-8602-d96af5cca188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.533452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.536129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.537028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.537345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.537593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] PATH_INFO: `/v3/projects/6d43a2c49bd34d549c967d2051a56be2` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.543853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d43a2c49bd34d549c967d2051a56be2)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.545902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.607713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 867/1735] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:40.619397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.619785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.620689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.649421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:40.651265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.655747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d43a2c49bd34d549c967d2051a56be2', 'request_id': 'req-fc135ca1-d881-4713-bf6d-7c2a8c34b795'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.665655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d43a2c49bd34d549c967d2051a56be2', 'request_id': 'req-fc135ca1-d881-4713-bf6d-7c2a8c34b795'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.677798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d43a2c49bd34d549c967d2051a56be2', 'request_id': 'req-fc135ca1-d881-4713-bf6d-7c2a8c34b795'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.697294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] The token cache is being invalidate because project 6d43a2c49bd34d549c967d2051a56be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:40.697767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.698443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.701020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 869/1736] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:40 2022] DELETE /identity/v3/projects/6d43a2c49bd34d549c967d2051a56be2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:40.707774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.709774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.796570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135ca1-d881-4713-bf6d-7c2a8c34b795 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.805589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 868/1737] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:40.807284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.807573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.808613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.809100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.809504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] PATH_INFO: `/v3/users/c31a99709abc4518a5148aeaf4cd05f6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.811114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31a99709abc4518a5148aeaf4cd05f6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.814301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.838935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd1fa9-09d8-46b4-8d74-5c1fa8ba7c67 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.850140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.851023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.851313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.851639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.860434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:40.861332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.863412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.882286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.884376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 869/1738] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:40.903998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.923197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31a99709abc4518a5148aeaf4cd05f6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.924810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31a99709abc4518a5148aeaf4cd05f6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.929516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c04bc-759d-449b-ab06-34bfa5bb2e04 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.936896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7fd2f-8078-4288-a19d-361cbccbbb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.938536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7fd2f-8078-4288-a19d-361cbccbbb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.939024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7fd2f-8078-4288-a19d-361cbccbbb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.941994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7fd2f-8078-4288-a19d-361cbccbbb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.944357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7fd2f-8078-4288-a19d-361cbccbbb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.946960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7fd2f-8078-4288-a19d-361cbccbbb1b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.952300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31a99709abc4518a5148aeaf4cd05f6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.964934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31a99709abc4518a5148aeaf4cd05f6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.975047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31a99709abc4518a5148aeaf4cd05f6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.991085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 870/1739] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:40 2022] DELETE /identity/v3/users/c31a99709abc4518a5148aeaf4cd05f6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:41.014046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 870/1740] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:41.015456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.020604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.106186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89c9ec-1140-4ce3-a432-59bcd6fcaa22 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.106765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89c9ec-1140-4ce3-a432-59bcd6fcaa22 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.106765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89c9ec-1140-4ce3-a432-59bcd6fcaa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.174035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1b89c9ec-1140-4ce3-a432-59bcd6fcaa22 None None] MFA Rules not processed for user `f9c66bf9125f45818c304b3f595f6211`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:41.180157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1b89c9ec-1140-4ce3-a432-59bcd6fcaa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.205409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9cb3-6c10-4542-8cc1-e0ae32bb4a3b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.403531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be73914-5d1f-413f-86ea-dd1c4c1c36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.404440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be73914-5d1f-413f-86ea-dd1c4c1c36b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.404728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be73914-5d1f-413f-86ea-dd1c4c1c36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.405012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be73914-5d1f-413f-86ea-dd1c4c1c36b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.405722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be73914-5d1f-413f-86ea-dd1c4c1c36b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.409571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be73914-5d1f-413f-86ea-dd1c4c1c36b8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.437591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 871/1741] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:41.443101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12490b0-952d-424b-9cac-6bafbd8b5732 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.443465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12490b0-952d-424b-9cac-6bafbd8b5732 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.443753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12490b0-952d-424b-9cac-6bafbd8b5732 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.448118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 871/1742] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/users => generated 288 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:41.452001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 872/1743] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 14 10:53:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:41.454501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.454501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.454700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.457753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.461259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.462124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.491532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] MFA Rules not processed for user `f9c66bf9125f45818c304b3f595f6211`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:41.492682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.505560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 872/1744] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:41.506766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.542512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c85ba7-9408-4be1-ad1e-b780a8d980a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.561424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.562099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.565639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.566032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.569581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.576305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.583065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] MFA Rules not processed for user `1f86dd9b76ef42e8a6fbff301df7d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:41.584437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.609358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:41.614914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 873/1745] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:41.627273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.629776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.710536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:41.717775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 873/1746] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:41.719976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.742016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9c73-8e87-4b7b-a84a-e7dda21539e4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.749695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.749695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.749695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.749695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.751180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.753569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.774977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 874/1747] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:41.780945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.786031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.813369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006ee6-2bc9-414e-bd7d-d2d7724f02a0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.819697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.823260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.824095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.824730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] PATH_INFO: `/v3/projects/e533743a5de84396b13085f81b16b17b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.827143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954380a-360b-4dab-af21-d9400ec19347 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.834495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.835171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.835572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.835939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.837843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e533743a5de84396b13085f81b16b17b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.841025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.848831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.850671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.887506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 874/1748] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:41.888456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.910858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1092-875b-4c80-85be-9492a1e7ed9d service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.920943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af79bb-e9bc-4170-ae9f-33991191c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.921963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af79bb-e9bc-4170-ae9f-33991191c414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.924943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af79bb-e9bc-4170-ae9f-33991191c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.925510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af79bb-e9bc-4170-ae9f-33991191c414 admin admin] PATH_INFO: `/v3/projects/0e432db930e54efcbc34a18ff43e0c0f/users/d535fd2d5de044928cc778d8b673523b/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.938135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e533743a5de84396b13085f81b16b17b', 'request_id': 'req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.946111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e533743a5de84396b13085f81b16b17b', 'request_id': 'req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.959309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af79bb-e9bc-4170-ae9f-33991191c414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e432db930e54efcbc34a18ff43e0c0f, user_id=d535fd2d5de044928cc778d8b673523b, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.962374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af79bb-e9bc-4170-ae9f-33991191c414 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.966293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e533743a5de84396b13085f81b16b17b', 'request_id': 'req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.982065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 875/1749] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:41 2022] PUT /identity/v3/projects/0e432db930e54efcbc34a18ff43e0c0f/users/d535fd2d5de044928cc778d8b673523b/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:41.992327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] The token cache is being invalidate because project e533743a5de84396b13085f81b16b17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:41.992798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.993614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4a8dcd0a-cc16-49d7-87fb-6e9b9eb86799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.994943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.995306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.995656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.996647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 875/1750] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:41 2022] DELETE /identity/v3/projects/e533743a5de84396b13085f81b16b17b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:42.001435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.001792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.002171 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.024441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.025740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.050195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] MFA Rules not processed for user `d535fd2d5de044928cc778d8b673523b`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.052176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.147383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 876/1751] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.147383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.147383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.152117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 876/1752] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.153722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.157825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.181007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4552-1af2-4b8f-b494-b55ed1c87c79 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.186211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.187347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.188387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.188954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] PATH_INFO: `/v3/projects/fb43600733894299b4995f08fb448da8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.190451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb43600733894299b4995f08fb448da8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.192849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.223089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.257254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ea71-8b5f-4e43-a47a-d9419168fa36 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.274472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb43600733894299b4995f08fb448da8', 'request_id': 'req-c85c2afb-a626-4d18-aea1-18de16082e13'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.300462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb43600733894299b4995f08fb448da8', 'request_id': 'req-c85c2afb-a626-4d18-aea1-18de16082e13'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.314419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb43600733894299b4995f08fb448da8', 'request_id': 'req-c85c2afb-a626-4d18-aea1-18de16082e13'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.328022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.338631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] The token cache is being invalidate because project fb43600733894299b4995f08fb448da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:42.339567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.343170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c85c2afb-a626-4d18-aea1-18de16082e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.350670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 877/1753] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:42 2022] DELETE /identity/v3/projects/fb43600733894299b4995f08fb448da8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:42.352617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.353100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.353460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.379685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.381274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.387127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.388103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.388565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.389036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.391411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.403345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.405188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.416749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 877/1754] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:42.417900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.419425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.463322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 878/1755] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.465099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.467869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.494174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a7fb2-0150-4f7e-80c5-48b380b83ee1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.501103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.502002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.502562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.502852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] PATH_INFO: `/v3/users/9a53472d53004bf687414253ad728375` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.504836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a53472d53004bf687414253ad728375)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.507091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.545519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36bd0b-90d9-4900-91ca-aa6a63d944a3 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.550460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.551134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.551419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.551695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.552981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.555910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.610535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 878/1756] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:42.611957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.630137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a53472d53004bf687414253ad728375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.631215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a53472d53004bf687414253ad728375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.654061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a53472d53004bf687414253ad728375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.670237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a53472d53004bf687414253ad728375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.686066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a5dc3ca9-9ab6-4cf0-9c0f-03b8cf3a6930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a53472d53004bf687414253ad728375'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.694025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 879/1757] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:42 2022] DELETE /identity/v3/users/9a53472d53004bf687414253ad728375 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:42.695658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10559d-476c-4c51-a757-c6bc3de9aaf0 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.695955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10559d-476c-4c51-a757-c6bc3de9aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.696516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10559d-476c-4c51-a757-c6bc3de9aaf0 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.704826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 880/1758] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 14 10:53:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:42.705877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10559d-476c-4c51-a757-c6bc3de9aaf0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.712305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aa10559d-476c-4c51-a757-c6bc3de9aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.736702 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ff5d4-7645-4d8b-8ea4-fdeaaa833c08 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.775700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.836519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.837455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.837890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.838317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.839206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:42.839662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.841469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb88fc-dcee-46e1-a135-1b77e9cd098c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.857319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10559d-476c-4c51-a757-c6bc3de9aaf0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.866885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ec462-3e41-4d3b-b4a4-6fcfb0aa68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.867626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ec462-3e41-4d3b-b4a4-6fcfb0aa68bb admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.868380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ec462-3e41-4d3b-b4a4-6fcfb0aa68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.868380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ec462-3e41-4d3b-b4a4-6fcfb0aa68bb admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.868850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ec462-3e41-4d3b-b4a4-6fcfb0aa68bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.870877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ec462-3e41-4d3b-b4a4-6fcfb0aa68bb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.889422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 879/1759] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:42.890976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.892118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.892118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.915362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.929010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 881/1760] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:42.930482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.930774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.931055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.958104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] MFA Rules not processed for user `1f86dd9b76ef42e8a6fbff301df7d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.959721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.989759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] MFA Rules not processed for user `5147d665ec624416a87056fb249f06b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.992091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.214652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 880/1761] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.215805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.217435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.235800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 882/1762] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.237186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.253355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc490ba-9e1f-43c9-b6e0-3bd56112ff95 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.262338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e937694-ba7b-40b7-b3a9-cabeebbdeeb0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.276829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12749321-fe3a-491b-b744-84fae9eb1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.277937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749321-fe3a-491b-b744-84fae9eb1806 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.278365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749321-fe3a-491b-b744-84fae9eb1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.278780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749321-fe3a-491b-b744-84fae9eb1806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.279667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12749321-fe3a-491b-b744-84fae9eb1806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.282133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12749321-fe3a-491b-b744-84fae9eb1806 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.283777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681939b-68f1-4a5a-884a-0d4d878fe72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.284493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681939b-68f1-4a5a-884a-0d4d878fe72d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.284875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681939b-68f1-4a5a-884a-0d4d878fe72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.285156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681939b-68f1-4a5a-884a-0d4d878fe72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.286005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681939b-68f1-4a5a-884a-0d4d878fe72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.291204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681939b-68f1-4a5a-884a-0d4d878fe72d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.330741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 883/1763] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:43.332689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.333223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.333627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.336612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 881/1764] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:43.342965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.343335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.343634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.376002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] MFA Rules not processed for user `df5446a1745d4fde8d036fa81deb0727`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:43.377854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.388369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] MFA Rules not processed for user `e1ab1b7c858d4d269d0079a12984f96c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:43.390151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.502052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 882/1765] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.503293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.505098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.539049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 884/1766] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.540136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.541643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.568159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:43.581452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39b49b-940b-4b0e-9a67-068ea80f03c8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.585740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.586592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.586948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.588764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.597797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.599497 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.609720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 883/1767] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:43.610787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.637066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269963-1ec3-4f5f-8c42-fe9bfa78d621 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.645182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.646350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.646713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.647067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.683771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:43.736643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.738524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.744955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2e54-90bb-494e-ad39-7220e7b24115 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.750783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 885/1768] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:43.751378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.753870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23e2d-2861-4cb6-8157-bacb9665957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.755307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23e2d-2861-4cb6-8157-bacb9665957a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.755757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23e2d-2861-4cb6-8157-bacb9665957a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.756241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23e2d-2861-4cb6-8157-bacb9665957a admin admin] PATH_INFO: `/v3/projects/1b35d8365c434149a213704baf0533fe/users/eef02a3f719b45c9be87809f5ffa8959/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.764375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f373b6f-43aa-402c-803e-e7ffe5262f5f service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.769768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.770506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.770772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.771065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.771755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.774125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.777417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23e2d-2861-4cb6-8157-bacb9665957a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b35d8365c434149a213704baf0533fe, user_id=eef02a3f719b45c9be87809f5ffa8959, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.780534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23e2d-2861-4cb6-8157-bacb9665957a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.800988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 884/1769] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:43 2022] PUT /identity/v3/projects/1b35d8365c434149a213704baf0533fe/users/eef02a3f719b45c9be87809f5ffa8959/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:43.802867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 886/1770] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:43.803097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19da53-d101-43cc-9f5c-454c5f400a2f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.803387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19da53-d101-43cc-9f5c-454c5f400a2f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.803666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19da53-d101-43cc-9f5c-454c5f400a2f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.804763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.805366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 885/1771] 10.222.0.64 () {54 vars in 960 bytes} [Thu Jul 14 10:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:43.810873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19da53-d101-43cc-9f5c-454c5f400a2f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.812863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0e19da53-d101-43cc-9f5c-454c5f400a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.816954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.841205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027a4c-eeb8-4ea5-a8b5-5208d6f04571 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.961351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19da53-d101-43cc-9f5c-454c5f400a2f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.965763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.966960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.968289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.968833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] PATH_INFO: `/v3/projects/254a54cd3cc44bc7808707c9549b80fb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.970753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254a54cd3cc44bc7808707c9549b80fb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.973199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.977146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.977825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.978108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.978983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.979689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.986618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.050602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 886/1772] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/projects => generated 403 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:44.051457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.060331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254a54cd3cc44bc7808707c9549b80fb', 'request_id': 'req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.075301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254a54cd3cc44bc7808707c9549b80fb', 'request_id': 'req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.094274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254a54cd3cc44bc7808707c9549b80fb', 'request_id': 'req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.111207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] The token cache is being invalidate because project 254a54cd3cc44bc7808707c9549b80fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:44.111501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.112232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.113830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 887/1773] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:43 2022] DELETE /identity/v3/projects/254a54cd3cc44bc7808707c9549b80fb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:44.114808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.116183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.196848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:44.209501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:44.226236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9d0d3-6059-4c9b-910c-1655ef0aea4f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.263820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0031c5-9f7d-4e69-910c-ab9443cdbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.265201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0031c5-9f7d-4e69-910c-ab9443cdbaba admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.265313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cba45-4e5f-48dc-b0d9-0f91ca7a5c41 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.267040 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0031c5-9f7d-4e69-910c-ab9443cdbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.267580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0031c5-9f7d-4e69-910c-ab9443cdbaba admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.273389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0031c5-9f7d-4e69-910c-ab9443cdbaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.274153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0031c5-9f7d-4e69-910c-ab9443cdbaba admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.290030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.304956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.305102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.305365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.306135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.309218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 887/1774] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:44.309725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.316181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.329768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.331227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.338561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 888/1775] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:44.339408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.342695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.359848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddacc86-5fea-4dfb-8420-deebe5e76888 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.376800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e7b5-6d78-4321-a47c-a894c674089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.377492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e7b5-6d78-4321-a47c-a894c674089c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.377822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e7b5-6d78-4321-a47c-a894c674089c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.378104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e7b5-6d78-4321-a47c-a894c674089c admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.379249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2e7b5-6d78-4321-a47c-a894c674089c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.385113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:44.387346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2e7b5-6d78-4321-a47c-a894c674089c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.388357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.437291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 889/1776] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:44.442094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.445715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.446589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.485485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 888/1777] 10.222.0.64 () {58 vars in 1057 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:44.486357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.487786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.495408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:44.497061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.503277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0ca3f-bc87-44be-a97d-a4c95e8173bc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.509478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.509642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 890/1778] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:44.510492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.510839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.511134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.511574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.512505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.514740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.526434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388597b-8014-474c-8e5c-f6b852f494e3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.530828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 889/1779] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:44.532579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.533317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.534453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.534860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.535208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] PATH_INFO: `/v3/projects/1b35d8365c434149a213704baf0533fe/users/eef02a3f719b45c9be87809f5ffa8959/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.536285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.538132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b35d8365c434149a213704baf0533fe, user_id=eef02a3f719b45c9be87809f5ffa8959, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.541575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.557755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 891/1780] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:44 2022] PUT /identity/v3/projects/1b35d8365c434149a213704baf0533fe/users/eef02a3f719b45c9be87809f5ffa8959/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:44.558770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.564941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9016a98-527d-4862-8c56-a089bf646faf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.660577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2d0cb-532d-42bd-aef0-ffbf8b4c10fd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.663006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.663828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.664190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.664572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.665978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d4a23-7d2f-4b2b-830d-ee40f49e4aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.666578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d4a23-7d2f-4b2b-830d-ee40f49e4aba admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.666866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d4a23-7d2f-4b2b-830d-ee40f49e4aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.667145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d4a23-7d2f-4b2b-830d-ee40f49e4aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.667265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.668274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d4a23-7d2f-4b2b-830d-ee40f49e4aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.670229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d4a23-7d2f-4b2b-830d-ee40f49e4aba admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.681674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.683270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.690091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 892/1781] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:44.691648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3faeb-fdbe-42e9-8a02-54daa27c952c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.691949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3faeb-fdbe-42e9-8a02-54daa27c952c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.692738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3faeb-fdbe-42e9-8a02-54daa27c952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.700983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 890/1782] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:44.707262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.724866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9db3faeb-fdbe-42e9-8a02-54daa27c952c None None] MFA Rules not processed for user `f9c66bf9125f45818c304b3f595f6211`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:44.727069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9db3faeb-fdbe-42e9-8a02-54daa27c952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.727862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a502f9-cf91-4915-ab8d-cd42ed4796d6 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.747961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca1870-6327-4b1e-bc19-501ec5649d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.748821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca1870-6327-4b1e-bc19-501ec5649d1c service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.749169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca1870-6327-4b1e-bc19-501ec5649d1c service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.750210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca1870-6327-4b1e-bc19-501ec5649d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.770288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca1870-6327-4b1e-bc19-501ec5649d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.772094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca1870-6327-4b1e-bc19-501ec5649d1c service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.787615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 891/1783] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:44.794182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.795440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.796319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.863627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:44.868022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.891805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 892/1784] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:44.892759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.898039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 893/1785] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:44.900362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32206e8b-a100-45cc-9455-43a43361817b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.900591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32206e8b-a100-45cc-9455-43a43361817b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.900876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32206e8b-a100-45cc-9455-43a43361817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.921103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807148c7-52c7-40ed-ae6e-90b76407ed45 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.935326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.936328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.936611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.936963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] PATH_INFO: `/v3/projects/630e4093c51b445aa9fc466d77578727/users/b54c95c2d96f4f86817cf664c39799bf/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.982701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=630e4093c51b445aa9fc466d77578727, user_id=b54c95c2d96f4f86817cf664c39799bf, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.991124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.016492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 893/1786] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:44 2022] PUT /identity/v3/projects/630e4093c51b445aa9fc466d77578727/users/b54c95c2d96f4f86817cf664c39799bf/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:45.029076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-32206e8b-a100-45cc-9455-43a43361817b None None] MFA Rules not processed for user `eef02a3f719b45c9be87809f5ffa8959`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:45.030276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.040463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-32206e8b-a100-45cc-9455-43a43361817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:45.091502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:45.154759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:45.182604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63826f-312c-4bbc-8d48-8628da520cbd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.188039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:45.190048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.190340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.190623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] PATH_INFO: `/v3/projects/32b653e62f734ff3bdf06121a5029440/users/5bcd7ce4a8a44036ab7df1f0419d213e/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.211453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b653e62f734ff3bdf06121a5029440, user_id=5bcd7ce4a8a44036ab7df1f0419d213e, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:45.215410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.258087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 894/1787] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:45 2022] PUT /identity/v3/projects/32b653e62f734ff3bdf06121a5029440/users/5bcd7ce4a8a44036ab7df1f0419d213e/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:45.259137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.366030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 894/1788] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:45.369648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.369744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.369988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.438836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8324-e17e-4711-9713-24d339b2ce71 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.461231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] MFA Rules not processed for user `b54c95c2d96f4f86817cf664c39799bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:45.462854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:45.483978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:45.484377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.485186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.485462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.493436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:45.493436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:45.504965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.546851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 895/1789] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:45.553589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.584975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466e49-aaf2-4ae9-8aba-b2ca6bb6b6bd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.615294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:45.621326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.621701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.626138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.627061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:45.628848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.636040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 895/1790] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:45.638110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.643267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:45.676877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 896/1791] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:45.677877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.727684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f153c-6e2f-4ee1-bcce-16210ca52381 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.740369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:45.741595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.742104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.742949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.744440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:45.746601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.807415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 897/1792] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:45 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:45.809073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.868438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e5456-4d17-481f-a646-8cb3015aa870 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.982861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660c65-bc39-4e09-b104-9f90a63ef913 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.007105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.008957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.009810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.011578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.012447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.014841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.050949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:46.069554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.073814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.077023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.077386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.086774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:46.091110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 898/1793] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:45 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:46.092363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.149614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:46.260026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.261204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.298711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 896/1794] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:46.301103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f41651-6395-48b9-897e-eddd85b808eb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.302412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.319366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.322001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.322293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.322582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] PATH_INFO: `/v3/projects/32b653e62f734ff3bdf06121a5029440/users/5bcd7ce4a8a44036ab7df1f0419d213e/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.329925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b653e62f734ff3bdf06121a5029440, user_id=5bcd7ce4a8a44036ab7df1f0419d213e, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.337477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.348213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dd901-ad3b-4d1d-a897-9530a8ff5ae3 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.374264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.377755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 899/1795] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:46 2022] PUT /identity/v3/projects/32b653e62f734ff3bdf06121a5029440/users/5bcd7ce4a8a44036ab7df1f0419d213e/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:46.378241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.378532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.378818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.379529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.380820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.394861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.499902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 897/1796] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:46.509583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.553864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03963769-9d8b-4fc9-a558-a8fc413fbe81 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.568795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d39e-7e1c-44d0-9b26-e17f1ebe864a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.577724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.583222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.585316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.585906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.586833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.593016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.595595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.598021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.598147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.599636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.602377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.613377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.664200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 898/1797] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:46.666286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.707453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 900/1798] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/users => generated 295 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:46.711643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.714893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957000bd-af38-4526-82bc-adc94e8ae1cc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.735202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.740188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.740816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.742113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.744656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.754406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.756131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3132-375a-49c6-8074-be3750a8a58f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.773434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.775205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.775205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.775205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.777922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.783123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.792418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 899/1799] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:46.795855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.823148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4895f3-d187-4e6b-b76b-50f66d94589f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.832626 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 901/1800] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:46.835985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.863367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3fec5-625d-47fd-9054-52196bbd7254 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.879056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9097c-ab6c-445d-b26f-4c4cf1f47166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.879987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9097c-ab6c-445d-b26f-4c4cf1f47166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.880312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9097c-ab6c-445d-b26f-4c4cf1f47166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.880595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9097c-ab6c-445d-b26f-4c4cf1f47166 admin admin] PATH_INFO: `/v3/projects/a0d5811e23d74e099620be8df27a32de/users/a79d46595df244f7bc27e310dfe9424f/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.883432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.889135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.891130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.891430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] PATH_INFO: `/v3/projects/6b03d145d8324a96a0615537cc7bc412/users/fac7a9c604cf40ef87516cfb34038014/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.940120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b03d145d8324a96a0615537cc7bc412, user_id=fac7a9c604cf40ef87516cfb34038014, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.947570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9097c-ab6c-445d-b26f-4c4cf1f47166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d5811e23d74e099620be8df27a32de, user_id=a79d46595df244f7bc27e310dfe9424f, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.948821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.956505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9097c-ab6c-445d-b26f-4c4cf1f47166 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.984842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 902/1801] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:46 2022] PUT /identity/v3/projects/6b03d145d8324a96a0615537cc7bc412/users/fac7a9c604cf40ef87516cfb34038014/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:46.989402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.007771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 900/1802] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:46 2022] PUT /identity/v3/projects/a0d5811e23d74e099620be8df27a32de/users/a79d46595df244f7bc27e310dfe9424f/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:47.019248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.019427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.019645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.094475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] MFA Rules not processed for user `a79d46595df244f7bc27e310dfe9424f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:47.098654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.129552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:47.233288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23bf98-aa96-49a3-9201-c33c1f3eeb13 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.365252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 901/1803] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:47.372220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.430662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.432836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.433807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.434494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.436016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.446092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.479315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 903/1804] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:47.482768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.507826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2be76-3b8b-4df6-8047-83294d1e92eb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.514876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:47.523016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7289e-ebba-48bf-98bc-9a44151681b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.527601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7289e-ebba-48bf-98bc-9a44151681b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.528055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7289e-ebba-48bf-98bc-9a44151681b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.528942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7289e-ebba-48bf-98bc-9a44151681b3 admin admin] PATH_INFO: `/v3/projects/6b03d145d8324a96a0615537cc7bc412/users/fac7a9c604cf40ef87516cfb34038014/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.533968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7289e-ebba-48bf-98bc-9a44151681b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b03d145d8324a96a0615537cc7bc412, user_id=fac7a9c604cf40ef87516cfb34038014, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.539326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7289e-ebba-48bf-98bc-9a44151681b3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.572310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207700-5510-4773-9f6d-d63c101c66d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.579196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 904/1805] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:47 2022] PUT /identity/v3/projects/6b03d145d8324a96a0615537cc7bc412/users/fac7a9c604cf40ef87516cfb34038014/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:47.594581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.594918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.595348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.711427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] MFA Rules not processed for user `fac7a9c604cf40ef87516cfb34038014`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:47.712632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.766782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.767663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.767971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.768336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.769047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.771105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.829382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 902/1806] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/projects => generated 387 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:47.838307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.900327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 905/1807] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:47.911580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.007759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9253011-58eb-4def-9f59-ff2ea2e3db0c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.019961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.021134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.021592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.021952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.023993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:48.031993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.083130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 903/1808] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:48.084951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.097015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244adf1-25a3-49b3-b8ec-c8b8ddb21e25 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.139513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2515a48-6f46-4194-81c2-9a016284de22 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.148433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:48.164101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.166353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.166663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.166953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.167739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:48.169487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.232281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 904/1809] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:48.235350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.292415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cbbc6-a467-4ee7-b004-dd91ac2f6126 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.305164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.306382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.309721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.310134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] PATH_INFO: `/v3/projects/1cdc19c7f32b47c6890c7899d6ecde98/users/2223e1ea724a4445a44892f6c49d4f88/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.325640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.326347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.326586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.326868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.449605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdc19c7f32b47c6890c7899d6ecde98, user_id=2223e1ea724a4445a44892f6c49d4f88, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:48.455815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.503281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 905/1810] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:48 2022] PUT /identity/v3/projects/1cdc19c7f32b47c6890c7899d6ecde98/users/2223e1ea724a4445a44892f6c49d4f88/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:48.504563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.506501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:48.539696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:48.549999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.576535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:48.582076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 906/1811] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:48.583269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.632875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9ce4-5039-4186-a3f8-898cbbaaa2a3 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.742359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a581a9-0570-47ab-9fac-16ec209f940a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.764871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586220c0-221a-4dbb-9426-fa95d26d110e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.767461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586220c0-221a-4dbb-9426-fa95d26d110e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.768842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586220c0-221a-4dbb-9426-fa95d26d110e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.769814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586220c0-221a-4dbb-9426-fa95d26d110e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.998496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.002328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.005112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.005886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.010990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.020056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.034923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586220c0-221a-4dbb-9426-fa95d26d110e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.044837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586220c0-221a-4dbb-9426-fa95d26d110e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.075815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 907/1812] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:49.077002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.102437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 906/1813] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:49.118704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00114d-146a-4d38-87da-7cf9591d93d8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.140406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5151bc7-35da-4232-97f9-29ba11929873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.141667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5151bc7-35da-4232-97f9-29ba11929873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.141844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5151bc7-35da-4232-97f9-29ba11929873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.142131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5151bc7-35da-4232-97f9-29ba11929873 admin admin] PATH_INFO: `/v3/projects/1cdc19c7f32b47c6890c7899d6ecde98/users/2223e1ea724a4445a44892f6c49d4f88/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.150771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5151bc7-35da-4232-97f9-29ba11929873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdc19c7f32b47c6890c7899d6ecde98, user_id=2223e1ea724a4445a44892f6c49d4f88, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.153493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5151bc7-35da-4232-97f9-29ba11929873 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.204258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 908/1814] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:49 2022] PUT /identity/v3/projects/1cdc19c7f32b47c6890c7899d6ecde98/users/2223e1ea724a4445a44892f6c49d4f88/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:49.214320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.214855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.215101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.337746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] MFA Rules not processed for user `2223e1ea724a4445a44892f6c49d4f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:49.340141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.362224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a63f3-f2d4-4b77-87a0-d8f5b2602eec None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.362889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a63f3-f2d4-4b77-87a0-d8f5b2602eec None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.363316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a63f3-f2d4-4b77-87a0-d8f5b2602eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.528610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5b9a63f3-f2d4-4b77-87a0-d8f5b2602eec None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:49.533884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5b9a63f3-f2d4-4b77-87a0-d8f5b2602eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.564443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 907/1815] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:49.604482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.614173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:49.786325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 909/1816] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:49.789156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.789564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.789958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.867361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] MFA Rules not processed for user `5147d665ec624416a87056fb249f06b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:49.869307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.891977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeb21a-1695-4d22-906c-54ef6dccab9e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.911738 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.914458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.919769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.922393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.969193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 910/1817] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:49.980080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.986737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.041158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 908/1818] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:50.143797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.145886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:50.385886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.401934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:50.458299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a785c2-6a98-4849-8a36-9bf7e7de3f01 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.491840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804287-e089-48ca-a2d3-1640adc45907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.493465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804287-e089-48ca-a2d3-1640adc45907 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.493763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804287-e089-48ca-a2d3-1640adc45907 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.494048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804287-e089-48ca-a2d3-1640adc45907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.520932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b804287-e089-48ca-a2d3-1640adc45907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.523083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b804287-e089-48ca-a2d3-1640adc45907 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.572819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 911/1819] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:53:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:53:50.615940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4347-cff1-45b7-9bb1-f873c4333b3a service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.634635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.635548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.635834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.641652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] PATH_INFO: `/v3/users/a79d46595df244f7bc27e310dfe9424f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.644586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79d46595df244f7bc27e310dfe9424f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.646562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.871361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79d46595df244f7bc27e310dfe9424f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.874266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79d46595df244f7bc27e310dfe9424f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.939633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79d46595df244f7bc27e310dfe9424f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.967700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79d46595df244f7bc27e310dfe9424f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.994522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79d46595df244f7bc27e310dfe9424f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.026749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 909/1820] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:50 2022] DELETE /identity/v3/users/a79d46595df244f7bc27e310dfe9424f => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:51.031185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.032169 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.032631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.111235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:51.112920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.242664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:51.405507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 912/1821] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:51.566118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.568725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.718526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a1cd-c0ca-4291-9d2a-ef4da5ae33b3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.740522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c787b8d-b8c5-4910-8476-89d90abbf99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.744655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c787b8d-b8c5-4910-8476-89d90abbf99b service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.744956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c787b8d-b8c5-4910-8476-89d90abbf99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.748465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c787b8d-b8c5-4910-8476-89d90abbf99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.799919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c787b8d-b8c5-4910-8476-89d90abbf99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.803611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c787b8d-b8c5-4910-8476-89d90abbf99b service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.839641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 910/1822] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:52.565387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.567704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.899000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580e106-ff3e-4da6-98c3-4f157c731538 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.907441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.908564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.909001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.909448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.911565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.110310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.114483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.135279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 913/1823] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:53.523854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3f63-2772-4ecd-bdba-8d29b1694f15 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.524442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3f63-2772-4ecd-bdba-8d29b1694f15 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.524442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3f63-2772-4ecd-bdba-8d29b1694f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.583430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bd9f3f63-2772-4ecd-bdba-8d29b1694f15 None None] MFA Rules not processed for user `5bcd7ce4a8a44036ab7df1f0419d213e`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:53.588291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bd9f3f63-2772-4ecd-bdba-8d29b1694f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.703440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:53.769968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.772252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.833640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abd73-8e38-4fa4-af8e-51d10f3f5a0b service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.845386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.847462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.849420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.849969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] PATH_INFO: `/v3/users/d535fd2d5de044928cc778d8b673523b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.853159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d535fd2d5de044928cc778d8b673523b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.861536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.976153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 911/1824] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:53.978769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.979240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.979355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.047838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] MFA Rules not processed for user `1f86dd9b76ef42e8a6fbff301df7d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:54.051632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.070787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 912/1825] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Jul 14 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:54.095340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd535fd2d5de044928cc778d8b673523b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:54.102942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd535fd2d5de044928cc778d8b673523b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:54.109676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.111513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.133385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a9ca-bf87-4555-bf4f-d48805e2be09 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.165122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.166031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.166322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.166608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.168830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd535fd2d5de044928cc778d8b673523b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:54.173623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.203459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd535fd2d5de044928cc778d8b673523b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:54.219831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.222343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.226768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95166a1c-d349-4789-8084-e21238753524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd535fd2d5de044928cc778d8b673523b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:54.232395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:54.254116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 914/1826] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:53 2022] DELETE /identity/v3/users/d535fd2d5de044928cc778d8b673523b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:54.258356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0235-48b2-4155-8246-2c87c8967eb7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.259400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0235-48b2-4155-8246-2c87c8967eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.262784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0235-48b2-4155-8246-2c87c8967eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.277441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 913/1827] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:54.335920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-40aa0235-48b2-4155-8246-2c87c8967eb7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:54.335920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-40aa0235-48b2-4155-8246-2c87c8967eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.442349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 915/1828] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:54.498442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.500175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.532384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68fab-5477-4265-b277-bf86834c07cc service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.718053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.721937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.723524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.724691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.773000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.782775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.833366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 914/1829] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:56.717685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def49e-82f4-47bf-9a09-be3e5c58206c None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.718264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def49e-82f4-47bf-9a09-be3e5c58206c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.718264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def49e-82f4-47bf-9a09-be3e5c58206c None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.719746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 916/1830] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:56.785288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.787521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.825506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170efd2-0550-41db-8ac6-2e0b56763b67 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.864290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.864620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.864910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.869125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.870269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.870762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.871268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] PATH_INFO: `/v3/projects/a0d5811e23d74e099620be8df27a32de` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.877618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d5811e23d74e099620be8df27a32de)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.881649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.903573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:56.904876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.083146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d5811e23d74e099620be8df27a32de', 'request_id': 'req-dba8dab6-1b52-4074-9c22-262695e384a0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.100967 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d5811e23d74e099620be8df27a32de', 'request_id': 'req-dba8dab6-1b52-4074-9c22-262695e384a0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.119748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d5811e23d74e099620be8df27a32de', 'request_id': 'req-dba8dab6-1b52-4074-9c22-262695e384a0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.161210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] The token cache is being invalidate because project a0d5811e23d74e099620be8df27a32de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:57.163981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.167087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 917/1831] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:57.168452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.168867 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.173309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 915/1832] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:56 2022] DELETE /identity/v3/projects/a0d5811e23d74e099620be8df27a32de => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:57.175504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.179381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.183148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.220240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea4a9d-0386-41a1-b7fb-549f5c10d084 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.294340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:57.436593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.438657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.438657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.438856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] PATH_INFO: `/v3/projects/0e432db930e54efcbc34a18ff43e0c0f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.441949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e432db930e54efcbc34a18ff43e0c0f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.444047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.498893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8dab6-1b52-4074-9c22-262695e384a0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.514232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.515141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.515463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.515837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] PATH_INFO: `/v3/users/2223e1ea724a4445a44892f6c49d4f88` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.521853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2223e1ea724a4445a44892f6c49d4f88)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.528589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.598261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:57.637078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e432db930e54efcbc34a18ff43e0c0f', 'request_id': 'req-b845c99e-dea3-470d-b938-fe4617f0421c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.643210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2223e1ea724a4445a44892f6c49d4f88'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.643968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2223e1ea724a4445a44892f6c49d4f88'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.673760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2223e1ea724a4445a44892f6c49d4f88'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.682041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2223e1ea724a4445a44892f6c49d4f88'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.689176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e432db930e54efcbc34a18ff43e0c0f', 'request_id': 'req-b845c99e-dea3-470d-b938-fe4617f0421c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.707854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2223e1ea724a4445a44892f6c49d4f88'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.710684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e432db930e54efcbc34a18ff43e0c0f', 'request_id': 'req-b845c99e-dea3-470d-b938-fe4617f0421c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.719326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 916/1833] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:57 2022] DELETE /identity/v3/users/2223e1ea724a4445a44892f6c49d4f88 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:57.719952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.721951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.732769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] The token cache is being invalidate because project 0e432db930e54efcbc34a18ff43e0c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:57.733671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.735744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.738825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 918/1834] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:57 2022] DELETE /identity/v3/projects/0e432db930e54efcbc34a18ff43e0c0f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:57.742645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.745758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.955114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845c99e-dea3-470d-b938-fe4617f0421c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.959330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c850d0d-bbb9-40a9-9423-8245686cdea8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.027099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.030625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.030625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.030947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.045216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.090325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.091493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.091935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.092394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] PATH_INFO: `/v3/users/eef02a3f719b45c9be87809f5ffa8959` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.094447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.095253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef02a3f719b45c9be87809f5ffa8959)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.097559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.099206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.135425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 917/1835] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:58.182267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef02a3f719b45c9be87809f5ffa8959'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.184004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef02a3f719b45c9be87809f5ffa8959'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.208828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef02a3f719b45c9be87809f5ffa8959'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.228619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef02a3f719b45c9be87809f5ffa8959'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.231404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:58.246752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef02a3f719b45c9be87809f5ffa8959'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.260113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 919/1836] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:57 2022] DELETE /identity/v3/users/eef02a3f719b45c9be87809f5ffa8959 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:59.222920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.263104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6ded-bbcf-4dd7-bdd1-aea6b92f602f service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.308603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.310917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.330347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.384344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.386038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.386508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.386891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] PATH_INFO: `/v3/projects/1b35d8365c434149a213704baf0533fe` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.388397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b35d8365c434149a213704baf0533fe)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.391921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.495401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b35d8365c434149a213704baf0533fe', 'request_id': 'req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.505476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b35d8365c434149a213704baf0533fe', 'request_id': 'req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.522418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b35d8365c434149a213704baf0533fe', 'request_id': 'req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.522769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff1ef0-41a6-40f5-bdcf-5754420e519b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.548777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] The token cache is being invalidate because project 1b35d8365c434149a213704baf0533fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:59.550751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.554741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c4626abc-3d49-4a65-b1f3-b08b07e92fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.558775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 918/1837] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:59 2022] DELETE /identity/v3/projects/1b35d8365c434149a213704baf0533fe => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:59.568466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72c1bf-a76c-493e-9b4e-8f9063850f88 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.568466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72c1bf-a76c-493e-9b4e-8f9063850f88 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.568466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72c1bf-a76c-493e-9b4e-8f9063850f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.596787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4f72c1bf-a76c-493e-9b4e-8f9063850f88 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.598516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4f72c1bf-a76c-493e-9b4e-8f9063850f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.647868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.648777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.649148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.649353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] PATH_INFO: `/v3/projects/1cdc19c7f32b47c6890c7899d6ecde98` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.653624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdc19c7f32b47c6890c7899d6ecde98)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.655550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.700790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 919/1838] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:59.710298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.710592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.710898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.740804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.743604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.750849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdc19c7f32b47c6890c7899d6ecde98', 'request_id': 'req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.767029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdc19c7f32b47c6890c7899d6ecde98', 'request_id': 'req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.778704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdc19c7f32b47c6890c7899d6ecde98', 'request_id': 'req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.803131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] The token cache is being invalidate because project 1cdc19c7f32b47c6890c7899d6ecde98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:59.803427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.804579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae9bac06-55dd-4a2a-9d6a-f7088e90a296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:59.812167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 920/1839] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:59 2022] DELETE /identity/v3/projects/1cdc19c7f32b47c6890c7899d6ecde98 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:59.814414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742724-ab58-4522-8440-fdb12079d7ee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.814704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742724-ab58-4522-8440-fdb12079d7ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.814991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742724-ab58-4522-8440-fdb12079d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.866661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-46742724-ab58-4522-8440-fdb12079d7ee None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.867895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46742724-ab58-4522-8440-fdb12079d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.886883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.907879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 920/1840] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:59.912563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.933973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.938090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ac7fe-5548-4bed-bc42-4bb7c9d25c73 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.951550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.954063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.958284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.958284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.959720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:59.960050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.966601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.991988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 921/1841] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:59.996809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.018831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 921/1842] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:00.025157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347fd65-a02b-4f47-b90d-bcf9742035e1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.027350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.027640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.027918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.061122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:00.065537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:00.075076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.076472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.077053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.077627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.079354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.082213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.089913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 922/1843] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:00.093973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.111797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bbfe3-b69e-4d13-9068-adc105e120e1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.131119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.131871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.132329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.132550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.133256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:00.133561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.135190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.166016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 922/1844] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:00.174893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 923/1845] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:00.175240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.179513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.211802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07c96-0319-4ad9-bc24-3631ce2e4b38 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.334552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.335395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.335481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.335757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.336502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.338417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.395129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 924/1846] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:00 2022] POST /identity/v3/projects => generated 407 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:00.398789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.456653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b581-7355-41c5-91c9-d5434c06175f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.557844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab98c-f826-474c-ae7c-211fa3d48dcd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.578197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.579135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.579592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.580231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.581244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.585362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.638418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 925/1847] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:00 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:00.643748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.681509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4631-4b6c-44de-a1d7-282bf87816df admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.689906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.691168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.693135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.694015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.695084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.697799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.712685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 926/1848] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:00.717375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.739455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f0e70-8a5a-4770-9eee-7a44e38a17aa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.745530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.746755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.746755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.749054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.752161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.754413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.776703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 927/1849] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:00.778254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.786262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:00.795197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a675eeb-32cc-4c40-915e-250bf6ec6994 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.808616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.812523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.812890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.813316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] PATH_INFO: `/v3/projects/b3b36051c8184dcb8bc0af54d0ef3a13/users/260a99dfdee64e29995db9ce51bc1081/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.815109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.815876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.816262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.817289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.818009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.821668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.845304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b36051c8184dcb8bc0af54d0ef3a13, user_id=260a99dfdee64e29995db9ce51bc1081, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.849919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.866409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 923/1850] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:00 2022] POST /identity/v3/users => generated 289 bytes in 699 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:00.871067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.879505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 928/1851] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:00 2022] PUT /identity/v3/projects/b3b36051c8184dcb8bc0af54d0ef3a13/users/260a99dfdee64e29995db9ce51bc1081/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:00.892595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a483-b70e-45c8-9824-491a8a004b14 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.893221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.897322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:00.999332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1f1d-3bf3-442e-9ab4-a2722a9602e5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:01.005318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:01.006654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.007030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.007520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] PATH_INFO: `/v3/users/e1ab1b7c858d4d269d0079a12984f96c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.009106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ab1b7c858d4d269d0079a12984f96c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:01.011393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:01.029413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0a69-3a6e-43e3-ab50-20c42e235bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:01.030152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0a69-3a6e-43e3-ab50-20c42e235bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.030576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0a69-3a6e-43e3-ab50-20c42e235bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.031515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0a69-3a6e-43e3-ab50-20c42e235bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.032369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac0a69-3a6e-43e3-ab50-20c42e235bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:01.045022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac0a69-3a6e-43e3-ab50-20c42e235bc2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:01.048554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:01.066773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 924/1852] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:01.070850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.070850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.070850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.095916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ab1b7c858d4d269d0079a12984f96c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:01.096761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ab1b7c858d4d269d0079a12984f96c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:01.115493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ab1b7c858d4d269d0079a12984f96c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:01.117620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] MFA Rules not processed for user `260a99dfdee64e29995db9ce51bc1081`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:01.119578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:01.128731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ab1b7c858d4d269d0079a12984f96c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:01.142482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ab1b7c858d4d269d0079a12984f96c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:01.159890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 929/1853] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:00 2022] DELETE /identity/v3/users/e1ab1b7c858d4d269d0079a12984f96c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:01.160843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:01.163403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:01.275013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:01.290941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219709-6b5c-4f51-a99c-0bcee5c1315a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:01.305746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f24074-7d37-4621-90b8-8af59f60d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:01.307078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f24074-7d37-4621-90b8-8af59f60d185 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.307715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f24074-7d37-4621-90b8-8af59f60d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.308971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f24074-7d37-4621-90b8-8af59f60d185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.309485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f24074-7d37-4621-90b8-8af59f60d185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:01.314310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f24074-7d37-4621-90b8-8af59f60d185 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:01.332473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 930/1854] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:01.336220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bbc4b-b37d-446b-b9bd-3f51cccbbb37 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.336892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bbc4b-b37d-446b-b9bd-3f51cccbbb37 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.336892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bbc4b-b37d-446b-b9bd-3f51cccbbb37 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.338244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 931/1855] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:54:01.339098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bbc4b-b37d-446b-b9bd-3f51cccbbb37 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:01.347217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 925/1856] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:01.353838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:01.353838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:01.376996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bbc4b-b37d-446b-b9bd-3f51cccbbb37 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:01.388252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bb186-8d63-4e96-9bd3-7be8a9e6ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:01.390625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bb186-8d63-4e96-9bd3-7be8a9e6ed55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.390921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bb186-8d63-4e96-9bd3-7be8a9e6ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.391214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bb186-8d63-4e96-9bd3-7be8a9e6ed55 admin admin] PATH_INFO: `/v3/projects/e4e45664675f480aba18cbdcb7cf6e21/users/8879db3feb694f51bca48be940e125a7/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.398553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff363a26-7a8f-4f62-b1a4-f1a2b1f9de63 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:01.414114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65060ce-8b1e-4a87-a758-e0403cd79761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:01.416736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65060ce-8b1e-4a87-a758-e0403cd79761 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.417829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65060ce-8b1e-4a87-a758-e0403cd79761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.418283 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65060ce-8b1e-4a87-a758-e0403cd79761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.419042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65060ce-8b1e-4a87-a758-e0403cd79761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:01.427081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65060ce-8b1e-4a87-a758-e0403cd79761 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:01.440931 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bb186-8d63-4e96-9bd3-7be8a9e6ed55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e45664675f480aba18cbdcb7cf6e21, user_id=8879db3feb694f51bca48be940e125a7, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:01.444022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bb186-8d63-4e96-9bd3-7be8a9e6ed55 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:01.477451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 932/1857] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:01 2022] PUT /identity/v3/projects/e4e45664675f480aba18cbdcb7cf6e21/users/8879db3feb694f51bca48be940e125a7/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:01.479064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.480805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.481100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.503976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 926/1858] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/projects => generated 407 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:01.508575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.508894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.509151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.534392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:01.536003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:01.548268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] MFA Rules not processed for user `8879db3feb694f51bca48be940e125a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:01.550714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:01.691716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 933/1859] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:01.692086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:01.710402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 927/1860] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:01.712227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:01.815460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:01.827091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc108f07-1b48-4fa2-b092-65fea9f22ab4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:01.833603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:01.834748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:01.835257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:01.835713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:01.836826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:01.839247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:01.906265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba4a5-dae9-4b75-9bcd-0fefb5440cdd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:01.911355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 928/1861] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:01.913652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.026742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.027532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.027823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.028130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.028823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.031490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.071462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47037ca2-3a71-4bfb-b81f-c3d9a638c396 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.074637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:02.080486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.081934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.082786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.083432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.084387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.087332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.093512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 934/1862] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/users => generated 310 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:02.094922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.098328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:02.135401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 929/1863] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:01 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:02.144110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.174359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb39dd-7bd9-4078-85f6-71186fbc1ebd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.186436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.187974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.188496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.188937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.189891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.198043 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.229058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 930/1864] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:02.229981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.254544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63641d8a-1015-4104-81ad-d8057f54837e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.271103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.271884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.272161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.272553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.274003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.276003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.288623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83fdd-f82f-4a03-895e-f17af775e3df admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.302801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 931/1865] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:02.304515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.305441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.305550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.305824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.308496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.332145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747876fc-2cb9-481f-9d99-b8127c4fee12 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.334723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.336622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.341766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.342818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.343100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.343904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] PATH_INFO: `/v3/projects/49b18962cd124d8989aad4e8d8b5d3d3/users/0b4bb719bc7142bcb4aa3d7c498666f7/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.361065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 935/1866] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:02.362162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.382692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b18962cd124d8989aad4e8d8b5d3d3, user_id=0b4bb719bc7142bcb4aa3d7c498666f7, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.385563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.392124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d39794-a7eb-49eb-b259-e48a7d07ed4b service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.398049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.399030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.399269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.399841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] PATH_INFO: `/v3/projects/6da474570bf0410e89a2b9695fb5b328/users/113bf108bc1d4f249d5c01ba7947a213/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.406959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 932/1867] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:02 2022] PUT /identity/v3/projects/49b18962cd124d8989aad4e8d8b5d3d3/users/0b4bb719bc7142bcb4aa3d7c498666f7/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:02.411032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.470960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da474570bf0410e89a2b9695fb5b328, user_id=113bf108bc1d4f249d5c01ba7947a213, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.478078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.526606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 936/1868] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:02 2022] PUT /identity/v3/projects/6da474570bf0410e89a2b9695fb5b328/users/113bf108bc1d4f249d5c01ba7947a213/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:02.530596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.594561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c08ba-2ea3-4e40-b420-ac22ebe47c41 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.684129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:02.722293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5649f-eff2-489d-8009-f0168b878b84 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.749509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.750793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.751101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.751353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.752109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.764251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.781661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.782363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.782674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.782919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.783928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.785585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.801545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 937/1869] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:02.804695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.829405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 933/1870] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:02.831968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b147c-c1d3-4880-8a93-6a54318f9d68 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.833448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:02.847569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a87d58-5414-4b84-8dfa-26773f49b80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.855256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87d58-5414-4b84-8dfa-26773f49b80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.855556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87d58-5414-4b84-8dfa-26773f49b80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.855838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87d58-5414-4b84-8dfa-26773f49b80a admin admin] PATH_INFO: `/v3/projects/6da474570bf0410e89a2b9695fb5b328/users/113bf108bc1d4f249d5c01ba7947a213/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.866059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a87d58-5414-4b84-8dfa-26773f49b80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da474570bf0410e89a2b9695fb5b328, user_id=113bf108bc1d4f249d5c01ba7947a213, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.868763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a87d58-5414-4b84-8dfa-26773f49b80a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.876140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03b2f-0e6d-4923-809c-3fca9ad8a5a7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:02.884725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85933f-2273-42db-9a96-fec8f651954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:02.885908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85933f-2273-42db-9a96-fec8f651954a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.886193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85933f-2273-42db-9a96-fec8f651954a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.886524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85933f-2273-42db-9a96-fec8f651954a admin admin] PATH_INFO: `/v3/projects/49b18962cd124d8989aad4e8d8b5d3d3/users/0b4bb719bc7142bcb4aa3d7c498666f7/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.890688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85933f-2273-42db-9a96-fec8f651954a admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b18962cd124d8989aad4e8d8b5d3d3, user_id=0b4bb719bc7142bcb4aa3d7c498666f7, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:02.894280 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85933f-2273-42db-9a96-fec8f651954a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:02.904144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 938/1871] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:02 2022] PUT /identity/v3/projects/6da474570bf0410e89a2b9695fb5b328/users/113bf108bc1d4f249d5c01ba7947a213/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:02.914415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.914704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.914988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.940670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 934/1872] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:02 2022] PUT /identity/v3/projects/49b18962cd124d8989aad4e8d8b5d3d3/users/0b4bb719bc7142bcb4aa3d7c498666f7/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:02.952861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:02.953172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:02.953406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:02.964280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] MFA Rules not processed for user `113bf108bc1d4f249d5c01ba7947a213`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:02.965507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:03.005536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:03.016897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] MFA Rules not processed for user `0b4bb719bc7142bcb4aa3d7c498666f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:03.018724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:03.062086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 939/1873] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:03.074336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:03.076396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:03.214000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a5354-7c30-4b5f-93b8-a84ec1f95557 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:03.231354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:03.232070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:03.237707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:03.237994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:03.276942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:03.284437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:03.329406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 940/1874] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:03.331116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:03.345075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:03.369452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 935/1875] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:03.475635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:03.491032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba32fb-d3a0-4e2c-b0d5-9f7c95e759a4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:03.500450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:03.501496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:03.505026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:03.505548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:03.534289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385982-d67d-400f-919d-b1e13f934850 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:03.535019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:03.540764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:03.547868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:03.548896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:03.549242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:03.549826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] PATH_INFO: `/v3/projects/f503993e700647f2aba5f1d9068b6737` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:03.551196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f503993e700647f2aba5f1d9068b6737)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:03.553692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:03.589719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 936/1876] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:03.649125 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f503993e700647f2aba5f1d9068b6737', 'request_id': 'req-eeef486a-c409-49a6-b926-0765cf587e72'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:03.662177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f503993e700647f2aba5f1d9068b6737', 'request_id': 'req-eeef486a-c409-49a6-b926-0765cf587e72'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:03.681786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f503993e700647f2aba5f1d9068b6737', 'request_id': 'req-eeef486a-c409-49a6-b926-0765cf587e72'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:03.702270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:03.711021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] The token cache is being invalidate because project f503993e700647f2aba5f1d9068b6737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:03.711120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:03.712227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:03.714365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 941/1877] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:03 2022] DELETE /identity/v3/projects/f503993e700647f2aba5f1d9068b6737 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:03.719580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:03.764982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0042-6f67-4b7e-a3d1-1955519fa542 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:03.904199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:03.907491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:03.908601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:03.908601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] PATH_INFO: `/v3/users/5bcd7ce4a8a44036ab7df1f0419d213e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:03.909669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcd7ce4a8a44036ab7df1f0419d213e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:03.911927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:04.005817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:04.062508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcd7ce4a8a44036ab7df1f0419d213e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:04.064519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcd7ce4a8a44036ab7df1f0419d213e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:04.106735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcd7ce4a8a44036ab7df1f0419d213e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:04.181560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcd7ce4a8a44036ab7df1f0419d213e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:04.196032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:04.201662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:04.213858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcd7ce4a8a44036ab7df1f0419d213e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:04.228187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 937/1878] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:03 2022] DELETE /identity/v3/users/5bcd7ce4a8a44036ab7df1f0419d213e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:04.376299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef486a-c409-49a6-b926-0765cf587e72 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:04.472772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:04.473449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.473728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.474001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.475964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:04.519369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:04.520962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:04.585560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:04.588490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:04.614793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47f151-48b2-4c7d-ac3a-3940eb9406f5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:04.620918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113bf108bc1d4f249d5c01ba7947a213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da474570bf0410e89a2b9695fb5b328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:04.621875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.622341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.622514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 942/1879] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:04.622877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.623910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:04.625030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:04.626992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:04.645908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:04.654249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 938/1880] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:04.662170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760eeda-b0e0-4f44-8a8d-741df1bdf912 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:04.669077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24784655-3b95-4b70-b967-d520f7c75555 tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113bf108bc1d4f249d5c01ba7947a213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da474570bf0410e89a2b9695fb5b328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:04.670782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24784655-3b95-4b70-b967-d520f7c75555 tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.671223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24784655-3b95-4b70-b967-d520f7c75555 tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.672525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24784655-3b95-4b70-b967-d520f7c75555 tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.673458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24784655-3b95-4b70-b967-d520f7c75555 tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:04.675694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24784655-3b95-4b70-b967-d520f7c75555 tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:04.735680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 943/1881] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:04 2022] POST /identity/v3/projects => generated 355 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:04.737035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:04.752286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d20ee-4ca1-4a49-8076-88d5a44694fd tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:04.803296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e90c4-dc67-4977-a522-ec26229a1045 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.803677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e90c4-dc67-4977-a522-ec26229a1045 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.804033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e90c4-dc67-4977-a522-ec26229a1045 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.805463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 944/1882] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:54:04.825447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.825951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.826388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.835026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113bf108bc1d4f249d5c01ba7947a213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da474570bf0410e89a2b9695fb5b328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:04.835825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.836145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.836460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.838096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:04.840630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:04.844152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:04.865925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 939/1883] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:04.866411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:04.867734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:04.957612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:04.972534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1925-aabc-4148-aa6e-b75b4a01467b tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:04.984995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '113bf108bc1d4f249d5c01ba7947a213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da474570bf0410e89a2b9695fb5b328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:04.988169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:04.988613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:04.990010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] PATH_INFO: `/v3/projects/f636c21053b9443894beb96239954fd7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:04.993033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f636c21053b9443894beb96239954fd7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:04.998431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:05.026359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:05.077698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 945/1884] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:05.156377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:05.202489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f636c21053b9443894beb96239954fd7', 'request_id': 'req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.226392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f636c21053b9443894beb96239954fd7', 'request_id': 'req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.238338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f636c21053b9443894beb96239954fd7', 'request_id': 'req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.257924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] The token cache is being invalidate because project f636c21053b9443894beb96239954fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:05.258523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.259845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.262344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 940/1885] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:04 2022] DELETE /identity/v3/projects/f636c21053b9443894beb96239954fd7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:05.442102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:05.443660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:05.458306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7307f-239c-45da-8bf0-96c6e403aaf7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:05.553014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:05.554567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:05.566247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:05.567178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:05.568106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:05.568106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:05.572550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:05.611584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:05.614269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:05.626990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 946/1886] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:05.637094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:05.644698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:05.682869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5678d9f-d1d5-4f97-ab59-1459a4e6b00d tempest-VolumeQuotaClassesTest-126583185 tempest-VolumeQuotaClassesTest-126583185-project-admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:05.688800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:05.690219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:05.691267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:05.691578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] PATH_INFO: `/v3/projects/32b653e62f734ff3bdf06121a5029440` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:05.693574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b653e62f734ff3bdf06121a5029440)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:05.697827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:05.797263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dbd81-6b39-4dbd-a85b-914894bc7951 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:05.832947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b653e62f734ff3bdf06121a5029440', 'request_id': 'req-6f00aa08-6d54-46b7-a1fd-7795403bb536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.852165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b653e62f734ff3bdf06121a5029440', 'request_id': 'req-6f00aa08-6d54-46b7-a1fd-7795403bb536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.881798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b653e62f734ff3bdf06121a5029440', 'request_id': 'req-6f00aa08-6d54-46b7-a1fd-7795403bb536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.899160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] The token cache is being invalidate because project 32b653e62f734ff3bdf06121a5029440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:05.899470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.901496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6f00aa08-6d54-46b7-a1fd-7795403bb536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:05.906338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 941/1887] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:05 2022] DELETE /identity/v3/projects/32b653e62f734ff3bdf06121a5029440 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:05.911547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c67e-6ea5-403c-b609-3558477f202e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:05.911837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c67e-6ea5-403c-b609-3558477f202e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:05.912130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1c67e-6ea5-403c-b609-3558477f202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:05.935248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:05.936177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:05.936479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:05.936731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] PATH_INFO: `/v3/users/8879db3feb694f51bca48be940e125a7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:05.938210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8879db3feb694f51bca48be940e125a7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:05.940183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:05.973557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-89a1c67e-6ea5-403c-b609-3558477f202e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:05.974804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-89a1c67e-6ea5-403c-b609-3558477f202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:05.986968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:05.997681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 942/1888] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:06.004950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.005366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.005745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.049646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:06.051515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.067804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 943/1889] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:06.069829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8879db3feb694f51bca48be940e125a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.071574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8879db3feb694f51bca48be940e125a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.072826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.085229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9df1-f7e8-483f-8ea7-e486e1c78a77 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.088200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8879db3feb694f51bca48be940e125a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.091276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.092112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.092922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.093347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.094218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:06.094616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.096535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.099590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8879db3feb694f51bca48be940e125a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.109272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-993410b6-fa50-42ed-a1b3-a08f3fbc0bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8879db3feb694f51bca48be940e125a7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.114333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 944/1890] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:06.119937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 947/1891] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:05 2022] DELETE /identity/v3/users/8879db3feb694f51bca48be940e125a7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:06.125425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.126221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.126623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.126907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.128524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.147886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97e915-1eb6-4cfe-8e05-48cbdc39d7ca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.159162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:06.160409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.195762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:06.285097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.285777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.286085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.286355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.287061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.289035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.290784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 948/1892] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:06.305514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.307290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.352842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 945/1893] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:06 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:06.354063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.475022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a4abc-1ecd-46c6-8bd2-f3657894576d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.533219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c670f2a-e794-471e-a31e-0cf4d996065a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.556193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.559206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.559500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.561210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.565176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.572579 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.632605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 946/1894] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:06 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:06.633615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.654681 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:06.663984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b298-44f9-4542-80ba-03afea03cf66 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.665012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.666112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.668187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.668703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.676726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.677076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.677345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.677632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.678404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.682228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.695531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.697562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.748711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 949/1895] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:06.778214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 947/1896] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:06.782680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.807408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822353d-790b-45b1-beab-f364021d41c0 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.819974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb84d4d-a1aa-48ef-ac36-c15a1d81770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.821437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb84d4d-a1aa-48ef-ac36-c15a1d81770c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.821437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb84d4d-a1aa-48ef-ac36-c15a1d81770c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.821664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb84d4d-a1aa-48ef-ac36-c15a1d81770c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.822372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb84d4d-a1aa-48ef-ac36-c15a1d81770c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.823997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb84d4d-a1aa-48ef-ac36-c15a1d81770c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.851775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 950/1897] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:06.852298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.882800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d64391-7028-4362-a2da-7491f89f1196 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.889168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.891879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.892389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.892672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] PATH_INFO: `/v3/projects/24b5581561c142e0b837f0bc538dbadf/users/509729e887174c63854ac02a1ef523dd/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.919808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b5581561c142e0b837f0bc538dbadf, user_id=509729e887174c63854ac02a1ef523dd, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.923341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.944126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 948/1898] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:06 2022] PUT /identity/v3/projects/24b5581561c142e0b837f0bc538dbadf/users/509729e887174c63854ac02a1ef523dd/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:06.956414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.956756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.957064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.013722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] MFA Rules not processed for user `509729e887174c63854ac02a1ef523dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:07.015859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.136775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 951/1899] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:07.141916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.256736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f797bc-2605-4d76-83ad-5ed79de432ea admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.270260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.271591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.271955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.272975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.273763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.278846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.285168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:07.323058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.326399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.344491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0da007-c780-4672-aba3-86eaaeb6baa6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.351285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 949/1900] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:07 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:07.352448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.443843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.444599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.444881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.445641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] PATH_INFO: `/v3/projects/e4e45664675f480aba18cbdcb7cf6e21` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.447268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e45664675f480aba18cbdcb7cf6e21)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.449838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.503619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a2a2-5e8f-42f2-a596-8c9824f7cb5f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.512148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.512897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.513191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.513628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.527198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.530726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.550073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e45664675f480aba18cbdcb7cf6e21', 'request_id': 'req-04e35d9f-7b2c-459d-855c-dcbe123eb63f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.564549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 950/1901] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:07 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:07.569037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.571520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e45664675f480aba18cbdcb7cf6e21', 'request_id': 'req-04e35d9f-7b2c-459d-855c-dcbe123eb63f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.585181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eb15a-2669-46f1-a67a-07df28124769 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.590514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e45664675f480aba18cbdcb7cf6e21', 'request_id': 'req-04e35d9f-7b2c-459d-855c-dcbe123eb63f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.604652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:07.614659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] The token cache is being invalidate because project e4e45664675f480aba18cbdcb7cf6e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:07.615132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.616420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.619230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 952/1902] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:07 2022] DELETE /identity/v3/projects/e4e45664675f480aba18cbdcb7cf6e21 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:07.623150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.626973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.697391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.699900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.700492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.701229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.703364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.705646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.722251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 951/1903] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:07.725904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.727618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.745560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b562-9b2f-4024-afee-24332ab60b31 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.752347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.753177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.753466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.753743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.754970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.757185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.767373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35d9f-7b2c-459d-855c-dcbe123eb63f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.771277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 952/1904] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:07.775792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.776832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.777761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.778048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.778322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] PATH_INFO: `/v3/users/113bf108bc1d4f249d5c01ba7947a213` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.784103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113bf108bc1d4f249d5c01ba7947a213)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.788386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.795462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c2be-4f20-4bd2-89d9-d9bac438b436 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.809985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b7554-d259-4cb7-b2cc-fc3e2354a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.813942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7554-d259-4cb7-b2cc-fc3e2354a138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.814653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7554-d259-4cb7-b2cc-fc3e2354a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.815891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7554-d259-4cb7-b2cc-fc3e2354a138 admin admin] PATH_INFO: `/v3/projects/c993ea6eb75c4a0e820144335d9a7367/users/667e0da1c95d4b5dab91f63a754b82fc/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.859788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7554-d259-4cb7-b2cc-fc3e2354a138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c993ea6eb75c4a0e820144335d9a7367, user_id=667e0da1c95d4b5dab91f63a754b82fc, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.866065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7554-d259-4cb7-b2cc-fc3e2354a138 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.880326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113bf108bc1d4f249d5c01ba7947a213'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.881460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113bf108bc1d4f249d5c01ba7947a213'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.908154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 953/1905] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:07 2022] PUT /identity/v3/projects/c993ea6eb75c4a0e820144335d9a7367/users/667e0da1c95d4b5dab91f63a754b82fc/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:07.917131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.917881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.918371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.925853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113bf108bc1d4f249d5c01ba7947a213'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.957528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113bf108bc1d4f249d5c01ba7947a213'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.978012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113bf108bc1d4f249d5c01ba7947a213'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.997995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 953/1906] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:07 2022] DELETE /identity/v3/users/113bf108bc1d4f249d5c01ba7947a213 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.003855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] MFA Rules not processed for user `667e0da1c95d4b5dab91f63a754b82fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:08.005530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.043275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:08.128007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 954/1907] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:08.129144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.131916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.228593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc2ed8-d79f-4beb-9ccf-78cd39c83456 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.235418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.236258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.236643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.237032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.237851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.239939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.274555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 954/1908] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:08.278439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.290705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbba9a4-ce33-44e6-9473-49800f7542fb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.404264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.405324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.406609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.407093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.408019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.411857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.447295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 955/1909] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:08.448803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.456267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:08.461675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635520ca-49f8-4133-aca3-8474e5a005d4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.505246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.508633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.509117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.509562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.511395 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.517512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.532124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.534180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.550036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2413f-ee64-4d43-a4a3-0c4fdd5107de admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.566766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.568208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.569642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.570197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] PATH_INFO: `/v3/projects/6da474570bf0410e89a2b9695fb5b328` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.572219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da474570bf0410e89a2b9695fb5b328)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.574766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.589094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 955/1910] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:08.591976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.611350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24918-6f77-4aab-afda-ee8524b6dbf6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.635412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.637467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.638096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.638606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] PATH_INFO: `/v3/projects/eec499d2cdce4b9ebe937b5ea442fd6d/users/d2f529e75c5048ea859f3a498224694f/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.669443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec499d2cdce4b9ebe937b5ea442fd6d, user_id=d2f529e75c5048ea859f3a498224694f, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.672757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.690260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da474570bf0410e89a2b9695fb5b328', 'request_id': 'req-2cb0ad76-4139-484b-966a-ebe7436078a6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.700488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da474570bf0410e89a2b9695fb5b328', 'request_id': 'req-2cb0ad76-4139-484b-966a-ebe7436078a6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.716040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da474570bf0410e89a2b9695fb5b328', 'request_id': 'req-2cb0ad76-4139-484b-966a-ebe7436078a6'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.734864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 956/1911] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:08 2022] PUT /identity/v3/projects/eec499d2cdce4b9ebe937b5ea442fd6d/users/d2f529e75c5048ea859f3a498224694f/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.740389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.751665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] The token cache is being invalidate because project 6da474570bf0410e89a2b9695fb5b328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:08.753961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.755390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2cb0ad76-4139-484b-966a-ebe7436078a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.760341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 956/1912] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:08 2022] DELETE /identity/v3/projects/6da474570bf0410e89a2b9695fb5b328 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.766836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40a11-e41e-4f9a-9df0-597c5d0f6878 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.767129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40a11-e41e-4f9a-9df0-597c5d0f6878 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.767664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40a11-e41e-4f9a-9df0-597c5d0f6878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.813274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-36f40a11-e41e-4f9a-9df0-597c5d0f6878 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:08.814506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36f40a11-e41e-4f9a-9df0-597c5d0f6878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.869476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:08.870043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28506f-d806-45ed-b8e8-b6f2f1399533 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.879883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a8091-cbc4-47c6-9ad3-e40bbbe65820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.881454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a8091-cbc4-47c6-9ad3-e40bbbe65820 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.881742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a8091-cbc4-47c6-9ad3-e40bbbe65820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.882020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a8091-cbc4-47c6-9ad3-e40bbbe65820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.882914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a8091-cbc4-47c6-9ad3-e40bbbe65820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.885087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a8091-cbc4-47c6-9ad3-e40bbbe65820 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.901757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 957/1913] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:08.901757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b9f7-6da7-4af8-a935-6b26e180d194 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.901757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b9f7-6da7-4af8-a935-6b26e180d194 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.901757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b9f7-6da7-4af8-a935-6b26e180d194 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.903197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 958/1914] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:54:08.903929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b9f7-6da7-4af8-a935-6b26e180d194 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.905833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eb52b9f7-6da7-4af8-a935-6b26e180d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.911976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 957/1915] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:08.914196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9875e1-2b0e-4936-8cd9-f400a7e3700c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.914663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9875e1-2b0e-4936-8cd9-f400a7e3700c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.915111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9875e1-2b0e-4936-8cd9-f400a7e3700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.926333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b9f7-6da7-4af8-a935-6b26e180d194 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.931785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f188bcd-6ccf-4ee3-9ec3-2e614002c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.933248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188bcd-6ccf-4ee3-9ec3-2e614002c1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.933602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188bcd-6ccf-4ee3-9ec3-2e614002c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.934545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188bcd-6ccf-4ee3-9ec3-2e614002c1ff admin admin] PATH_INFO: `/v3/projects/eec499d2cdce4b9ebe937b5ea442fd6d/users/d2f529e75c5048ea859f3a498224694f/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.936896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f188bcd-6ccf-4ee3-9ec3-2e614002c1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec499d2cdce4b9ebe937b5ea442fd6d, user_id=d2f529e75c5048ea859f3a498224694f, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.938597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cb9875e1-2b0e-4936-8cd9-f400a7e3700c None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:08.939851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cb9875e1-2b0e-4936-8cd9-f400a7e3700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.940556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f188bcd-6ccf-4ee3-9ec3-2e614002c1ff admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.962195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 959/1916] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:08 2022] PUT /identity/v3/projects/eec499d2cdce4b9ebe937b5ea442fd6d/users/d2f529e75c5048ea859f3a498224694f/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.962195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.962195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.962195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.980555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:08.981940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.047052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 958/1917] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.048427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.048719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.049001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.077636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 960/1918] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.077636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.078207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] MFA Rules not processed for user `d2f529e75c5048ea859f3a498224694f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:09.079635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.089068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.101828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a8a5-6b33-4b05-88c3-c9ac9523ff38 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.110523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.111412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.111689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.111965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] PATH_INFO: `/v3/users/b54c95c2d96f4f86817cf664c39799bf` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.113248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54c95c2d96f4f86817cf664c39799bf)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.115215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.163217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 959/1919] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.163932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.165363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.176324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54c95c2d96f4f86817cf664c39799bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:09.177424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54c95c2d96f4f86817cf664c39799bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:09.179051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:09.195182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54c95c2d96f4f86817cf664c39799bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:09.203465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54c95c2d96f4f86817cf664c39799bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:09.212971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54c95c2d96f4f86817cf664c39799bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:09.221157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 961/1920] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:09 2022] DELETE /identity/v3/users/b54c95c2d96f4f86817cf664c39799bf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:09.225206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.227224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.236363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:09.267628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d24225-2945-47c9-940a-3d6d22536cfd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.295363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c98e69-58fc-4919-aef1-028c35a32f40 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.300213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.300876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.301156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.301431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.302150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:09.302458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.304045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.316361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 962/1921] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:09.317333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.319048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.332925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.333604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.333885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.334162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.335896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.347299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.348895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c4cc4-2ad9-4ab0-8cf5-671ef85bdd40 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.359228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 960/1922] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:09.360299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.360589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.360866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.379066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:09.380277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.380544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659176-3c8a-4d6f-8e6b-4e2f152e25d9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.384660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.385315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.385585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.385849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.387786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.389443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 961/1923] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.391618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.401348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435dd8-1751-4754-ba59-e5a521df2ed4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.406574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.407231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.407521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.407913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.408652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.410553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.440188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 962/1924] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:09.440188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.440188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.459584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.461187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.471281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 963/1925] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:09.472042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.484654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd112c-ac2b-422c-891a-dbb257242aaf service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.490550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:09.499331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379607-71d4-4775-aac7-16b820602d92 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.504663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.505409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.505789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.505957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.565023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.565946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.566440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.566928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.568146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.570285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.606683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 964/1926] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:09.609549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.613041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.616444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.621350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393854f5-9d64-473f-b796-9c61e07e5462 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.627897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.628959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.629519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.630183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.631257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.632409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:09.634155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.647195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 963/1927] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:09.648005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 965/1928] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:09.651877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.664344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d69ea-30fb-4b13-970e-0e385c5d4ea5 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.671929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00075e87-60c4-4acc-806d-fa650d471f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.673245 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075e87-60c4-4acc-806d-fa650d471f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.673769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075e87-60c4-4acc-806d-fa650d471f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.674215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00075e87-60c4-4acc-806d-fa650d471f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.675144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00075e87-60c4-4acc-806d-fa650d471f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.677634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00075e87-60c4-4acc-806d-fa650d471f64 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.696554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 964/1929] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:09.701469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.713701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f753cde-dcd8-435a-8a7b-220d1e2852ce admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.720580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.723030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.723317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.723783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] PATH_INFO: `/v3/projects/239f479c55724ee0b0caebf13466a239/users/9cd92f00f7ac46eb87e5ad2a9079984d/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.756300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239f479c55724ee0b0caebf13466a239, user_id=9cd92f00f7ac46eb87e5ad2a9079984d, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.760521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.791062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 966/1930] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:09 2022] PUT /identity/v3/projects/239f479c55724ee0b0caebf13466a239/users/9cd92f00f7ac46eb87e5ad2a9079984d/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:09.802838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.803135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.803408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.832996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] MFA Rules not processed for user `9cd92f00f7ac46eb87e5ad2a9079984d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:09.834183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.966014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 965/1931] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.966766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.096755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d266-01f8-43e7-8895-ec8c678d6b13 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.102397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.104592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.105583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.106114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.113912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.120260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.158493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 967/1932] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:10.162776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.175139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1f9ea-033c-411c-9a33-f4de4542085d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.235432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.257523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.257911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.258199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.258481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.259178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.261339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.294277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 966/1933] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:10 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:10.295155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.298571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:10.315783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82fab2-28c0-4195-ba06-dedc1c3da3cd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.329018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.330260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.330608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.330958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] PATH_INFO: `/v3/projects/630e4093c51b445aa9fc466d77578727` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.332468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630e4093c51b445aa9fc466d77578727)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.334785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.334933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:10.340665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769c8a-2cbf-4862-9fdc-19d2ae6db9ae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.346462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.347130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.347868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.347868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.349747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:10.430137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630e4093c51b445aa9fc466d77578727', 'request_id': 'req-7941721e-aaf6-4f69-94db-7c386543c293'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.438825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630e4093c51b445aa9fc466d77578727', 'request_id': 'req-7941721e-aaf6-4f69-94db-7c386543c293'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.451374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630e4093c51b445aa9fc466d77578727', 'request_id': 'req-7941721e-aaf6-4f69-94db-7c386543c293'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.454493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:10.475775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] The token cache is being invalidate because project 630e4093c51b445aa9fc466d77578727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:10.476512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.477487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.479301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 967/1934] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:10 2022] DELETE /identity/v3/projects/630e4093c51b445aa9fc466d77578727 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:10.480246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.481617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:10.516880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.519471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.556630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 968/1935] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:10.557301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.577838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715044d1-5ae0-4e5c-ba7e-adae34be11f9 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.588510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941721e-aaf6-4f69-94db-7c386543c293 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.592272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.593337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.593601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.593879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] PATH_INFO: `/v3/users/fac7a9c604cf40ef87516cfb34038014` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.594336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.595064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.595174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac7a9c604cf40ef87516cfb34038014)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.595343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.595683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.596469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.597026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.598114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.620716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 968/1936] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:10.625517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.638867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622322-4755-4927-9881-8bf750107f09 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.653825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.656800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.657304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.657644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] PATH_INFO: `/v3/projects/6c42af2c40cc4d3cacac436d2fcd45dc/users/0193ab79af434b67ab9bd11b5201e322/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.693644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c42af2c40cc4d3cacac436d2fcd45dc, user_id=0193ab79af434b67ab9bd11b5201e322, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.697807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac7a9c604cf40ef87516cfb34038014'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.698679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.705118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac7a9c604cf40ef87516cfb34038014'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.721798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 969/1937] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:10 2022] PUT /identity/v3/projects/6c42af2c40cc4d3cacac436d2fcd45dc/users/0193ab79af434b67ab9bd11b5201e322/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:10.723408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.727910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:10.747456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac7a9c604cf40ef87516cfb34038014'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.763523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac7a9c604cf40ef87516cfb34038014'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.778572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac7a9c604cf40ef87516cfb34038014'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.790323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 969/1938] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:10 2022] DELETE /identity/v3/users/fac7a9c604cf40ef87516cfb34038014 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:10.831940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218852-8f94-497c-abe3-ca30cae7d810 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.944303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f8bf-22e4-4844-b957-c5bea12cbaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.945128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f8bf-22e4-4844-b957-c5bea12cbaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.945374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f8bf-22e4-4844-b957-c5bea12cbaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.945703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f8bf-22e4-4844-b957-c5bea12cbaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.946734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f8bf-22e4-4844-b957-c5bea12cbaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.955632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f8bf-22e4-4844-b957-c5bea12cbaa5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.985235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 970/1939] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:10.986839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.998902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9498865-4da6-453b-9414-6c066ce4c449 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.022654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.023938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.024282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.024571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] PATH_INFO: `/v3/projects/6c42af2c40cc4d3cacac436d2fcd45dc/users/0193ab79af434b67ab9bd11b5201e322/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.034007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c42af2c40cc4d3cacac436d2fcd45dc, user_id=0193ab79af434b67ab9bd11b5201e322, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.050659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.098189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 970/1940] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:10 2022] PUT /identity/v3/projects/6c42af2c40cc4d3cacac436d2fcd45dc/users/0193ab79af434b67ab9bd11b5201e322/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:11.108187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.108561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.108877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.136627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:11.179914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.183220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.193379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] MFA Rules not processed for user `0193ab79af434b67ab9bd11b5201e322`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:11.194622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.278667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a515d-5def-4e3c-8bea-c082dd20c039 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.285050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.287042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.287480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.287929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] PATH_INFO: `/v3/users/260a99dfdee64e29995db9ce51bc1081` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.289429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260a99dfdee64e29995db9ce51bc1081)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.291738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.297176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:11.325767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 971/1941] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:11.338126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.339805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.375558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260a99dfdee64e29995db9ce51bc1081'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.376286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260a99dfdee64e29995db9ce51bc1081'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.394754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260a99dfdee64e29995db9ce51bc1081'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.402655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260a99dfdee64e29995db9ce51bc1081'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.421884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf3fe-bafd-4417-9b47-63ebd7be5113 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.426592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.427378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.427669 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.427952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.430532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.436541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7bd1d3f5-402b-4d62-935d-af84dde36469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260a99dfdee64e29995db9ce51bc1081'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.445235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 971/1942] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:11 2022] DELETE /identity/v3/users/260a99dfdee64e29995db9ce51bc1081 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:11.448017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.449649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.450392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.451071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.451536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.469036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 972/1943] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:11.470840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.477448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.481818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:11.483025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.502774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfb984-2b2c-4671-b22d-207ee1725a4c service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.568861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 972/1944] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:11.576613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.577604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.577888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.578163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] PATH_INFO: `/v3/projects/6b03d145d8324a96a0615537cc7bc412` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.579484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b03d145d8324a96a0615537cc7bc412)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.580452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.581569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.582188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.639004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:11.667839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b03d145d8324a96a0615537cc7bc412', 'request_id': 'req-2e462e07-755e-467c-80e2-06520b4c91b5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.670903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb473-ee6a-46d4-829d-78f646c709d8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.677116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b03d145d8324a96a0615537cc7bc412', 'request_id': 'req-2e462e07-755e-467c-80e2-06520b4c91b5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.692991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b03d145d8324a96a0615537cc7bc412', 'request_id': 'req-2e462e07-755e-467c-80e2-06520b4c91b5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.712931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] The token cache is being invalidate because project 6b03d145d8324a96a0615537cc7bc412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:11.713494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.714773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2e462e07-755e-467c-80e2-06520b4c91b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:11.718961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 973/1945] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:11 2022] DELETE /identity/v3/projects/6b03d145d8324a96a0615537cc7bc412 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:11.725275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68920649-c37d-4504-b387-6196ac3933f4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.725649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68920649-c37d-4504-b387-6196ac3933f4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.726027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68920649-c37d-4504-b387-6196ac3933f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.742000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:11.771898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-68920649-c37d-4504-b387-6196ac3933f4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:11.772278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.773267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-68920649-c37d-4504-b387-6196ac3933f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.773756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.774188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.774848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.777496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.893472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 974/1946] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:11.902776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.903777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.904185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.929705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:11.930977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.938926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.940492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.944213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 975/1947] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:11.945375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.955781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a55ada-0c8a-4e6e-840e-6ed1bbb58856 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.959490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 973/1948] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:11.963140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.963998 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.964449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.965026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.965904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:11.966345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.968473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.989085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 976/1949] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:11.989899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.009803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b55a3-8263-4e6f-a897-b77365c09200 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.016511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.017638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.018141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.018429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.019163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.021384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.058027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 974/1950] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:12.063352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.075625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b45190-15d9-4e75-b40b-4e8cfb2ecc60 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.191175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.192031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.192371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.192652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.193368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.196597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.225995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 977/1951] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:12 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:12.230481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.246029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11090405-2382-4a4e-a8f3-66b274a377fe admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.261836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.262385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.262666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.262947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.263679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.265330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.291304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 975/1952] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:12.296451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.318090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.319909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94312d9-2ab9-41bb-9e27-92f7cfcce6b9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.323294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.336840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.337413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.338736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.339589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.341902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.346892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.363907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee91e3-54ce-4935-ba7e-214344cde7ba admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.367059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 978/1953] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:12.370883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.378477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.379376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.379656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.379932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] PATH_INFO: `/v3/projects/b3b36051c8184dcb8bc0af54d0ef3a13` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.381303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b36051c8184dcb8bc0af54d0ef3a13)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.383161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.388720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f469be-f419-484b-bda4-92e7b7f7407a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.396823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.398254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.399294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.399836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] PATH_INFO: `/v3/projects/21524b4a548544d19399bf632ef70c38/users/938eb139b9744ecab0e424753c835230/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.457220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21524b4a548544d19399bf632ef70c38, user_id=938eb139b9744ecab0e424753c835230, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.463567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.492439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:12.520001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 979/1954] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:12 2022] PUT /identity/v3/projects/21524b4a548544d19399bf632ef70c38/users/938eb139b9744ecab0e424753c835230/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:12.520001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.520001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.523382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b36051c8184dcb8bc0af54d0ef3a13', 'request_id': 'req-3147abd5-f5ce-4973-83e8-75d308d8f05b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.538798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b36051c8184dcb8bc0af54d0ef3a13', 'request_id': 'req-3147abd5-f5ce-4973-83e8-75d308d8f05b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.553822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b36051c8184dcb8bc0af54d0ef3a13', 'request_id': 'req-3147abd5-f5ce-4973-83e8-75d308d8f05b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.579564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] The token cache is being invalidate because project b3b36051c8184dcb8bc0af54d0ef3a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:12.579933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.583042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3147abd5-f5ce-4973-83e8-75d308d8f05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.584911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 976/1955] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:12 2022] DELETE /identity/v3/projects/b3b36051c8184dcb8bc0af54d0ef3a13 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:12.586246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.586516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.586800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.665311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] MFA Rules not processed for user `938eb139b9744ecab0e424753c835230`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:12.668603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.687558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a00f-b271-4cc4-a66e-5b081f08bd76 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.695716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.698471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.699100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.699727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] PATH_INFO: `/v3/users/9cd92f00f7ac46eb87e5ad2a9079984d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.702390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd92f00f7ac46eb87e5ad2a9079984d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.705312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.720861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:12.790121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd92f00f7ac46eb87e5ad2a9079984d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.790790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd92f00f7ac46eb87e5ad2a9079984d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.795434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 977/1956] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:12.798030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.800896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.807714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd92f00f7ac46eb87e5ad2a9079984d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.815814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd92f00f7ac46eb87e5ad2a9079984d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.818380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a340-301e-4de4-a0db-24a61b879781 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.824629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd92f00f7ac46eb87e5ad2a9079984d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.824839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.825731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.826085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.826434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] PATH_INFO: `/v3/users/0b4bb719bc7142bcb4aa3d7c498666f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.828956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4bb719bc7142bcb4aa3d7c498666f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.830990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.833222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 980/1957] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:12 2022] DELETE /identity/v3/users/9cd92f00f7ac46eb87e5ad2a9079984d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:12.834652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.836124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.900795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4bb719bc7142bcb4aa3d7c498666f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.901742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4bb719bc7142bcb4aa3d7c498666f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.933117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4bb719bc7142bcb4aa3d7c498666f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.949023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4bb719bc7142bcb4aa3d7c498666f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.957998 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32557b-6308-44a2-814b-c43618931fef admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.962965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-89cbba29-f7c1-474c-9fe6-149318b05c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4bb719bc7142bcb4aa3d7c498666f7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:12.965123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.966020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.966481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.966899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.967753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.971256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.980126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 978/1958] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:12 2022] DELETE /identity/v3/users/0b4bb719bc7142bcb4aa3d7c498666f7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:12.983020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.983337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.984310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.015798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:13.017425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.022971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 981/1959] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:12 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:13.027901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.031178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.040433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:13.114878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 979/1960] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:13.131041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.133629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.161733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbaa63-4fc3-443c-bd7c-771afd75a44c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.167049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.167948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.168324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.168663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.169437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.172402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.199710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 982/1961] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:13 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:13.204268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.211508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:13.217622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38a60-050c-4aba-b580-da5f2a98aff0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.223731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.224631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.225102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.225549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.226466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.229177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.238826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7094-4c68-4b6c-bc35-5414ae97faac None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.245390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 983/1962] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:13.258561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.269964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1b64-c55c-44f6-a76c-787a5470b7f3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.275609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.276717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.277155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.277579 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.278765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.280922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.297622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 984/1963] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:13.299174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.310345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d9d24-de33-4634-b3e4-985c9cb775a3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.315698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.316875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.317164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.317370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] PATH_INFO: `/v3/projects/989828fa0e8b4e7a9e5a293fa0722db9/users/e422c649e1c34655ab7d0f2e9ca670fe/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.329044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c59ac3-7642-4ab1-936c-70fee34d9228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.329705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c59ac3-7642-4ab1-936c-70fee34d9228 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.330072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c59ac3-7642-4ab1-936c-70fee34d9228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.330376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c59ac3-7642-4ab1-936c-70fee34d9228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.339629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989828fa0e8b4e7a9e5a293fa0722db9, user_id=e422c649e1c34655ab7d0f2e9ca670fe, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.340051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c59ac3-7642-4ab1-936c-70fee34d9228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.341661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c59ac3-7642-4ab1-936c-70fee34d9228 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.343625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.353071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 980/1964] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:13.359744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 985/1965] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:13 2022] PUT /identity/v3/projects/989828fa0e8b4e7a9e5a293fa0722db9/users/e422c649e1c34655ab7d0f2e9ca670fe/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:13.370239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.370540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.370879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.406227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] MFA Rules not processed for user `e422c649e1c34655ab7d0f2e9ca670fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:13.408243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.496049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 981/1966] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:13.500354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.533326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.535075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.575627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9435e7-6902-41fc-a24f-b490ffb571d4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.585110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.586322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.586783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.587137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.588570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.591489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.636399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab64ff2-c45f-47e0-80e1-fa3593829f14 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.642782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.646287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 986/1967] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:13 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:13.646428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.646428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.646428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] PATH_INFO: `/v3/projects/49b18962cd124d8989aad4e8d8b5d3d3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.647585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.648695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b18962cd124d8989aad4e8d8b5d3d3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.650630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.734142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:13.768384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:13.787986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b18962cd124d8989aad4e8d8b5d3d3', 'request_id': 'req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.797865 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b18962cd124d8989aad4e8d8b5d3d3', 'request_id': 'req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.811493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b18962cd124d8989aad4e8d8b5d3d3', 'request_id': 'req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.832503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] The token cache is being invalidate because project 49b18962cd124d8989aad4e8d8b5d3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:13.832780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.833769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5470fa3d-3eb8-49ba-be1e-0d45a90a5003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.835897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 982/1968] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:13 2022] DELETE /identity/v3/projects/49b18962cd124d8989aad4e8d8b5d3d3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:13.842390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7621e4-7cf7-4c5d-ae95-0c6a8ac089d6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.843326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7621e4-7cf7-4c5d-ae95-0c6a8ac089d6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.843894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7621e4-7cf7-4c5d-ae95-0c6a8ac089d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.870873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cd6c-d14d-4b7b-b880-30c55788ca0e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.890830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4f7621e4-7cf7-4c5d-ae95-0c6a8ac089d6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:13.893782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4f7621e4-7cf7-4c5d-ae95-0c6a8ac089d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.990715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.992219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.992651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.993135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.994417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.004656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.013787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 983/1969] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:14.022038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.023808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.024414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.048318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:14.050072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.051092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 987/1970] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:13 2022] POST /identity/v3/users => generated 295 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:14.055073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.058830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.063106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 984/1971] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:14.067321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.081198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4441-07a3-4237-b076-cf97d7cab07f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.086783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.087770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.088142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.088499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.089311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.090678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc3ea-c098-45b2-9cc9-836e758092ff None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.091859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.104367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.106140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 988/1972] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:14.106708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.107292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.107633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.108361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.110208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.111255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:14.112009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.117885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.126242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8ca74-e8c2-4235-bfc2-96fcd473939e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.135055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.136488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.136488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.136819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] PATH_INFO: `/v3/projects/239f479c55724ee0b0caebf13466a239` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.138394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239f479c55724ee0b0caebf13466a239)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.141444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.154419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 985/1973] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:14.157469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.189726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1e242-9c53-45dc-9dd2-0c7b2057af0d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.208893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.209830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.210102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.210418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] PATH_INFO: `/v3/projects/f3c2bc9864834a1c910a162ac3331fa1/users/50909754380b48cc861f6792e2fba816/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.236804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c2bc9864834a1c910a162ac3331fa1, user_id=50909754380b48cc861f6792e2fba816, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.237365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239f479c55724ee0b0caebf13466a239', 'request_id': 'req-d2398b77-0beb-475e-abdf-5079149fc404'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.240244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.245650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239f479c55724ee0b0caebf13466a239', 'request_id': 'req-d2398b77-0beb-475e-abdf-5079149fc404'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.254175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239f479c55724ee0b0caebf13466a239', 'request_id': 'req-d2398b77-0beb-475e-abdf-5079149fc404'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.260051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 986/1974] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:14 2022] PUT /identity/v3/projects/f3c2bc9864834a1c910a162ac3331fa1/users/50909754380b48cc861f6792e2fba816/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:14.263047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.270269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] The token cache is being invalidate because project 239f479c55724ee0b0caebf13466a239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:14.270625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.271299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.276376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 989/1975] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:14 2022] DELETE /identity/v3/projects/239f479c55724ee0b0caebf13466a239 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:14.276376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.276376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.342942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:14.348049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f353c-214b-4dcd-b301-2fdd07c32305 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.355252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.355943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.356663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.357582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.358309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.372707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2398b77-0beb-475e-abdf-5079149fc404 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.378928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.379629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.379911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.380237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.381139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.383199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.388668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.396268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 990/1976] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:14.397218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.399097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.417007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156ed7-d345-412c-affe-22e605349e14 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.423381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.424375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.424557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.424824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] PATH_INFO: `/v3/users/0193ab79af434b67ab9bd11b5201e322` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.426822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0193ab79af434b67ab9bd11b5201e322)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.428814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.429053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:14.436415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 987/1977] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:14 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:14.438159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.490960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0193ab79af434b67ab9bd11b5201e322'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.491650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0193ab79af434b67ab9bd11b5201e322'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.509035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0193ab79af434b67ab9bd11b5201e322'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.524195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0193ab79af434b67ab9bd11b5201e322'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.534800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda2078-6509-4806-92c8-42ad2c373c85 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.539592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0193ab79af434b67ab9bd11b5201e322'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.541434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6b479-9c73-443e-b810-7939b0ec553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.542006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6b479-9c73-443e-b810-7939b0ec553b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.542349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6b479-9c73-443e-b810-7939b0ec553b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.542817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6b479-9c73-443e-b810-7939b0ec553b admin admin] PATH_INFO: `/v3/projects/f3c2bc9864834a1c910a162ac3331fa1/users/50909754380b48cc861f6792e2fba816/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.555651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6b479-9c73-443e-b810-7939b0ec553b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c2bc9864834a1c910a162ac3331fa1, user_id=50909754380b48cc861f6792e2fba816, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.556555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 991/1978] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:14 2022] DELETE /identity/v3/users/0193ab79af434b67ab9bd11b5201e322 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:14.557808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6b479-9c73-443e-b810-7939b0ec553b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.558150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.560099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.576874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 988/1979] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:14 2022] PUT /identity/v3/projects/f3c2bc9864834a1c910a162ac3331fa1/users/50909754380b48cc861f6792e2fba816/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:14.588350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.588642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.589110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.636698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cac561-e3d7-4921-9f49-824620e326dd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.643485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] MFA Rules not processed for user `50909754380b48cc861f6792e2fba816`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:14.646243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.706465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:14.718032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.718781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.719090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.719381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.720329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.722808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.742995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 989/1980] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:14.747196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 992/1981] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:14 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:14.751450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.754816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.757035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.772546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdeb31-a353-49e8-84ec-c78769e6a272 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.779473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.780342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.781281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.781575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.783427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.785884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.800979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 990/1982] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:14.808317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.839731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f0f9b-518b-425a-a519-1676b2bc6ec9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.851264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.852145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.852778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.852883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9f0d-1124-4b0c-bd1c-01ce40468be3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.853167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.854123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.855912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.865654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7eb3e-21b9-4a4f-8e90-57327655fd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.866328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7eb3e-21b9-4a4f-8e90-57327655fd8b service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.866617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7eb3e-21b9-4a4f-8e90-57327655fd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.866891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7eb3e-21b9-4a4f-8e90-57327655fd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.880263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 991/1983] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:14.885038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.893336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7eb3e-21b9-4a4f-8e90-57327655fd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.895072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7eb3e-21b9-4a4f-8e90-57327655fd8b service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.897191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b1155-9e24-4b2a-87b4-145ca0a90522 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.906610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.907620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.907907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.908292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] PATH_INFO: `/v3/projects/5c3edebbf5cf42e79e5dd23fd60edf8b/users/12867bdde0f64629a0d6cc87b6c319fd/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.916200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 993/1984] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:14.930528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3edebbf5cf42e79e5dd23fd60edf8b, user_id=12867bdde0f64629a0d6cc87b6c319fd, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.933321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.949534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 992/1985] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:14 2022] PUT /identity/v3/projects/5c3edebbf5cf42e79e5dd23fd60edf8b/users/12867bdde0f64629a0d6cc87b6c319fd/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:14.955417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.955417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.955417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.957097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.958769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.974200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:14.975631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.998903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:15.031553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8c16-8cfa-4ead-ba62-1203d6f6965f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.035841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.036532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.036849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.037167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.038984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.042498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 994/1986] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:15.043154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.044444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.058057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d60c96-f3d2-4767-aaac-22dc9ecdf25a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.064390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.065248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.065538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.065785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] PATH_INFO: `/v3/projects/6c42af2c40cc4d3cacac436d2fcd45dc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.067202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c42af2c40cc4d3cacac436d2fcd45dc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.069153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.110784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.112277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.119923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c42af2c40cc4d3cacac436d2fcd45dc', 'request_id': 'req-5803f878-29f0-466f-a34c-ce14197d3fbb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.125397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 993/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:15.126805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.127028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c42af2c40cc4d3cacac436d2fcd45dc', 'request_id': 'req-5803f878-29f0-466f-a34c-ce14197d3fbb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.130028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.141016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c42af2c40cc4d3cacac436d2fcd45dc', 'request_id': 'req-5803f878-29f0-466f-a34c-ce14197d3fbb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.154402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] The token cache is being invalidate because project 6c42af2c40cc4d3cacac436d2fcd45dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:15.154770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.156207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5803f878-29f0-466f-a34c-ce14197d3fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.158116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 995/1988] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:15 2022] DELETE /identity/v3/projects/6c42af2c40cc4d3cacac436d2fcd45dc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:15.162555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdac635-75fd-46a1-9fcf-6d114fe207df None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.163021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdac635-75fd-46a1-9fcf-6d114fe207df None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.163855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdac635-75fd-46a1-9fcf-6d114fe207df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.183030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7fdac635-75fd-46a1-9fcf-6d114fe207df None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:15.184339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7fdac635-75fd-46a1-9fcf-6d114fe207df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.199153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17c628-0708-462a-9909-e9af3df71b2f service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.217735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:15.275556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.276741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.277434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.277818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.281451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.292029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 996/1989] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:15.301419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.301419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.301791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.302694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.305211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.324046 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 994/1990] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:15.325864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:15.327125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.344949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 997/1991] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:15.348659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.362735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904a20-434e-4362-8949-99289d9653d7 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.369174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.370104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.370401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.370750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.371562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:15.371944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.374815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.390563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 995/1992] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:15.395278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.407721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa24bb4-e437-49ac-918f-d6d17be9e00c None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.429361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.430392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.431073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.431529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.432825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.440029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.534283 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 998/1993] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:15 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:15.540187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.563697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a3b7-622e-475d-b92f-7429d41bbf80 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.649964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:15.778357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.781319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.783490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.786572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.787617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.798102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.849596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 996/1994] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:15 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:15.851347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.880860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5669139-b232-4463-affe-3b3ef6758a31 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.901886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.903014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.903485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.903965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.904956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.906933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:15.924423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 999/1995] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:15.926065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.935560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.938891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.944594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068dd8-6baf-4d48-bbbd-b730b2cb7a15 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:15.950511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:15.951196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:15.951466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:15.951885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:15.953379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:15.955001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.004471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 997/1996] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:16.006972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.024915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b68e2-7141-415f-8e63-8536dd8a045f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.044767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c1e6-49f8-4edf-ac39-b2734bcb1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.047851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c1e6-49f8-4edf-ac39-b2734bcb1450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.048179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c1e6-49f8-4edf-ac39-b2734bcb1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.048466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c1e6-49f8-4edf-ac39-b2734bcb1450 admin admin] PATH_INFO: `/v3/projects/bfa3bd27569f4e0d9c33474454c50d19/users/bc91b3a2174643aba9e8035525982e99/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.060014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347899a-6d41-4319-8f5a-77357dc1efca admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.067750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.068464 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.068761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.069035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.070986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:16.089099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c1e6-49f8-4edf-ac39-b2734bcb1450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa3bd27569f4e0d9c33474454c50d19, user_id=bc91b3a2174643aba9e8035525982e99, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.097257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c1e6-49f8-4edf-ac39-b2734bcb1450 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.143239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 998/1997] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:16 2022] PUT /identity/v3/projects/bfa3bd27569f4e0d9c33474454c50d19/users/bc91b3a2174643aba9e8035525982e99/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:16.146333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fd342-61dd-4ad7-bd76-7a34979bd7f9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.146683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fd342-61dd-4ad7-bd76-7a34979bd7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.146958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fd342-61dd-4ad7-bd76-7a34979bd7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.195696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-944fd342-61dd-4ad7-bd76-7a34979bd7f9 None None] MFA Rules not processed for user `bc91b3a2174643aba9e8035525982e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:16.197784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-944fd342-61dd-4ad7-bd76-7a34979bd7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:16.219391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.220896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.267117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1000/1998] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:16.374556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 999/1999] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:16.391333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.392809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:16.409548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acba2-2756-4ba2-916b-4342b8c6030c service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.476133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:16.521102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.522088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.522508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.522791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.553525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.556679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.570983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1001/2000] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:16.904520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2213-4616-450c-8eae-62cbf24d3e92 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.905976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2213-4616-450c-8eae-62cbf24d3e92 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.906429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2213-4616-450c-8eae-62cbf24d3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.964328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3a8b2213-4616-450c-8eae-62cbf24d3e92 None None] MFA Rules not processed for user `12867bdde0f64629a0d6cc87b6c319fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:16.966658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a8b2213-4616-450c-8eae-62cbf24d3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:17.110094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1000/2001] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:17.152930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:17.164498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e93c-cfa7-42a9-8217-18a72c0e1f41 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:17.173077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:17.173733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:17.174012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:17.174285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:17.193928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:17.208627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:17.228382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1002/2002] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:18.693477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.694418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.694924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.708812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:18.715204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] MFA Rules not processed for user `12867bdde0f64629a0d6cc87b6c319fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:18.716977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:18.730915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1001/2003] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:19.138086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:19.140602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:19.225806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bfecd-81be-445a-beea-312b628f7f02 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:19.230721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:19.231621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:19.231924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:19.232236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] PATH_INFO: `/v3/users/938eb139b9744ecab0e424753c835230` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:19.234638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938eb139b9744ecab0e424753c835230)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:19.237206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:19.276652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:19.279004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:19.294769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf45a8-4a23-4ef3-9bd1-29eda91fdba8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:19.301042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:19.302107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:19.302525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:19.302901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] PATH_INFO: `/v3/users/509729e887174c63854ac02a1ef523dd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:19.304318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] RBAC: Authorizing `identity:delete_user(user_id=509729e887174c63854ac02a1ef523dd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:19.306737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:19.310885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938eb139b9744ecab0e424753c835230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.312468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938eb139b9744ecab0e424753c835230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.329491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938eb139b9744ecab0e424753c835230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.338006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938eb139b9744ecab0e424753c835230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.348320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56a11269-9334-43c6-8992-6cd238297687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938eb139b9744ecab0e424753c835230'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.362337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1003/2004] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:19 2022] DELETE /identity/v3/users/938eb139b9744ecab0e424753c835230 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:19.367437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:19.368341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:19.369097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:19.386226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509729e887174c63854ac02a1ef523dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.386957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509729e887174c63854ac02a1ef523dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.400823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509729e887174c63854ac02a1ef523dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.404301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:19.406239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:19.409074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509729e887174c63854ac02a1ef523dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.420403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4ab142f7-4932-48f2-b792-f396402d977e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509729e887174c63854ac02a1ef523dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:19.429854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1002/2005] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:19 2022] DELETE /identity/v3/users/509729e887174c63854ac02a1ef523dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:19.435505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:19.435808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:19.436109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:19.457025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:19.458335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:19.468752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:19.521844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1004/2006] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:19.532490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:19.534443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:19.592531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1003/2007] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:19.657074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:19.659168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:19.709882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2628d-21b7-4601-a575-9d1ea12882d4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:19.824623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:19.825296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:19.825595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:19.825862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:19.833047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd0e31-98fd-4e9a-9b6f-6a37ce73304b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:19.845895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:19.846476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:19.846996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:19.847370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:19.852091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:19.853789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:19.867789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:19.874608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:19.900585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1005/2008] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:19.911033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1004/2009] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:20.768553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:20.770007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:20.787908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe950-2f6d-4144-a9c0-19ab4ca15cd1 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:20.798011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:20.798980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:20.799276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:20.799713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] PATH_INFO: `/v3/projects/21524b4a548544d19399bf632ef70c38` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:20.801593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21524b4a548544d19399bf632ef70c38)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:20.810549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:20.821589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:20.823914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:20.861530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663433-45d8-473b-ad25-f98589474e9b service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:20.885448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:20.888077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:20.888374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:20.888645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] PATH_INFO: `/v3/projects/24b5581561c142e0b837f0bc538dbadf` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:20.893809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b5581561c142e0b837f0bc538dbadf)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:20.921640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21524b4a548544d19399bf632ef70c38', 'request_id': 'req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:20.932247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:20.939034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21524b4a548544d19399bf632ef70c38', 'request_id': 'req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:20.957401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21524b4a548544d19399bf632ef70c38', 'request_id': 'req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:20.970518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:20.971348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] The token cache is being invalidate because project 21524b4a548544d19399bf632ef70c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:20.971641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:20.972537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:20.974757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1006/2010] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:20 2022] DELETE /identity/v3/projects/21524b4a548544d19399bf632ef70c38 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:20.978747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:20.980438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:21.008647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:21.052531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b5581561c142e0b837f0bc538dbadf', 'request_id': 'req-925cea7b-74b5-4adb-a5fa-8e461d894f67'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.068541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b5581561c142e0b837f0bc538dbadf', 'request_id': 'req-925cea7b-74b5-4adb-a5fa-8e461d894f67'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.089085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b5581561c142e0b837f0bc538dbadf', 'request_id': 'req-925cea7b-74b5-4adb-a5fa-8e461d894f67'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.117861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] The token cache is being invalidate because project 24b5581561c142e0b837f0bc538dbadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:21.118155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.120466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.123307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1005/2011] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:20 2022] DELETE /identity/v3/projects/24b5581561c142e0b837f0bc538dbadf => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:21.130605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:21.134189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:21.137072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cdea-85b1-415c-ac3d-f097c9f0feb3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:21.309472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:21.310370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:21.310655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:21.310988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] PATH_INFO: `/v3/users/e422c649e1c34655ab7d0f2e9ca670fe` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:21.313282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e422c649e1c34655ab7d0f2e9ca670fe)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:21.315578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:21.322305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cea7b-74b5-4adb-a5fa-8e461d894f67 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:21.335668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:21.337998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:21.339427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:21.340409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] PATH_INFO: `/v3/users/667e0da1c95d4b5dab91f63a754b82fc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:21.342953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667e0da1c95d4b5dab91f63a754b82fc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:21.345194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:21.399802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e422c649e1c34655ab7d0f2e9ca670fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.402051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e422c649e1c34655ab7d0f2e9ca670fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.433696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e422c649e1c34655ab7d0f2e9ca670fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.448934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e422c649e1c34655ab7d0f2e9ca670fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.451759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667e0da1c95d4b5dab91f63a754b82fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.453383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667e0da1c95d4b5dab91f63a754b82fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.461041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e422c649e1c34655ab7d0f2e9ca670fe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.489535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667e0da1c95d4b5dab91f63a754b82fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.490964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1007/2012] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:20 2022] DELETE /identity/v3/users/e422c649e1c34655ab7d0f2e9ca670fe => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:21.506161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667e0da1c95d4b5dab91f63a754b82fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.525539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667e0da1c95d4b5dab91f63a754b82fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:21.534816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1006/2013] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:21 2022] DELETE /identity/v3/users/667e0da1c95d4b5dab91f63a754b82fc => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:22.242244 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.244285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.264011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.266542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.319656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.376336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.402611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759816d-6aa4-41c9-9aa6-ddaeb71937d9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.408876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.410075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.410584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.411103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] PATH_INFO: `/v3/projects/c993ea6eb75c4a0e820144335d9a7367` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.413417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c993ea6eb75c4a0e820144335d9a7367)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.415613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.442632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef99cd-f726-4e55-8fac-3e9af14cfcdd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.478203 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.480284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.486381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.486722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] PATH_INFO: `/v3/projects/989828fa0e8b4e7a9e5a293fa0722db9` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.490735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989828fa0e8b4e7a9e5a293fa0722db9)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.500000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.537078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c993ea6eb75c4a0e820144335d9a7367', 'request_id': 'req-d23f64a9-ec5a-41f1-acef-bfa5021290ad'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.549918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c993ea6eb75c4a0e820144335d9a7367', 'request_id': 'req-d23f64a9-ec5a-41f1-acef-bfa5021290ad'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.561971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c993ea6eb75c4a0e820144335d9a7367', 'request_id': 'req-d23f64a9-ec5a-41f1-acef-bfa5021290ad'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.575400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989828fa0e8b4e7a9e5a293fa0722db9', 'request_id': 'req-4bd23c40-321b-4d6d-b343-8b52c6da19f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.584325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989828fa0e8b4e7a9e5a293fa0722db9', 'request_id': 'req-4bd23c40-321b-4d6d-b343-8b52c6da19f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.585107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] The token cache is being invalidate because project c993ea6eb75c4a0e820144335d9a7367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:22.585778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.586804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.588753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1007/2014] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/projects/c993ea6eb75c4a0e820144335d9a7367 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.594865 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.596662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.616730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989828fa0e8b4e7a9e5a293fa0722db9', 'request_id': 'req-4bd23c40-321b-4d6d-b343-8b52c6da19f4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.635221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] The token cache is being invalidate because project 989828fa0e8b4e7a9e5a293fa0722db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:22.635571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.637017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.638487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1008/2015] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/projects/989828fa0e8b4e7a9e5a293fa0722db9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.643167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.645945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.711623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f64a9-ec5a-41f1-acef-bfa5021290ad admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.724697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23c40-321b-4d6d-b343-8b52c6da19f4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.730267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.731254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.731691 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.731986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] PATH_INFO: `/v3/users/50909754380b48cc861f6792e2fba816` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.733799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50909754380b48cc861f6792e2fba816)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.735816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.775367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.785114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.786640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.787087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.787558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] PATH_INFO: `/v3/users/d2f529e75c5048ea859f3a498224694f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.788832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f529e75c5048ea859f3a498224694f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.790829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.798436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50909754380b48cc861f6792e2fba816'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.799224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50909754380b48cc861f6792e2fba816'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.827525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50909754380b48cc861f6792e2fba816'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.836834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50909754380b48cc861f6792e2fba816'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.841846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.846419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50909754380b48cc861f6792e2fba816'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.857705 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1009/2016] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/users/50909754380b48cc861f6792e2fba816 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.860887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f529e75c5048ea859f3a498224694f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.862013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f529e75c5048ea859f3a498224694f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.881902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f529e75c5048ea859f3a498224694f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.895061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f529e75c5048ea859f3a498224694f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.904293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f529e75c5048ea859f3a498224694f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.912116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1008/2017] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/users/d2f529e75c5048ea859f3a498224694f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:23.103419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.106608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.195877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef540a-1464-4501-ba9e-423e427030a1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.291621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.292638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.292932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.293282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] PATH_INFO: `/v3/users/bc91b3a2174643aba9e8035525982e99` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.297316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc91b3a2174643aba9e8035525982e99)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.299711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.323799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.325537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.350489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc30b7-3a55-4a52-ab87-0a70b0077da7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.363008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.364813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.365422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.365707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] PATH_INFO: `/v3/projects/eec499d2cdce4b9ebe937b5ea442fd6d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.367541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec499d2cdce4b9ebe937b5ea442fd6d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.369504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.379275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc91b3a2174643aba9e8035525982e99'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.380252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc91b3a2174643aba9e8035525982e99'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.406603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc91b3a2174643aba9e8035525982e99'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.415862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc91b3a2174643aba9e8035525982e99'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.433114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc91b3a2174643aba9e8035525982e99'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.438148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec499d2cdce4b9ebe937b5ea442fd6d', 'request_id': 'req-086d7d12-eb17-4da9-aa84-75289f6739e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.442846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1010/2018] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:23 2022] DELETE /identity/v3/users/bc91b3a2174643aba9e8035525982e99 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:23.442846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.448214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec499d2cdce4b9ebe937b5ea442fd6d', 'request_id': 'req-086d7d12-eb17-4da9-aa84-75289f6739e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.457243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.457532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec499d2cdce4b9ebe937b5ea442fd6d', 'request_id': 'req-086d7d12-eb17-4da9-aa84-75289f6739e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.472577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] The token cache is being invalidate because project eec499d2cdce4b9ebe937b5ea442fd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:23.472870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.473544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-086d7d12-eb17-4da9-aa84-75289f6739e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.479887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1009/2019] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:23 2022] DELETE /identity/v3/projects/eec499d2cdce4b9ebe937b5ea442fd6d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:23.481531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040dc03-760b-45de-b002-f6f3d77c715c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.481828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040dc03-760b-45de-b002-f6f3d77c715c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.482109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040dc03-760b-45de-b002-f6f3d77c715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.504210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1040dc03-760b-45de-b002-f6f3d77c715c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.505475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1040dc03-760b-45de-b002-f6f3d77c715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.543470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:23.581589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:23.591212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc663f8-1f76-4437-8f3c-1ba8cb85b92b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.597041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.597920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.598207 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.598488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] PATH_INFO: `/v3/projects/f3c2bc9864834a1c910a162ac3331fa1` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.599785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1010/2020] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.599894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c2bc9864834a1c910a162ac3331fa1)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.601481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.601843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.601935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.602202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.627315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.628956 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.637019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1011/2021] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.638016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.639343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.662001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c2bc9864834a1c910a162ac3331fa1', 'request_id': 'req-8922093b-89c2-448e-ad69-6a88731c59b8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.671047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c2bc9864834a1c910a162ac3331fa1', 'request_id': 'req-8922093b-89c2-448e-ad69-6a88731c59b8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.682495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c2bc9864834a1c910a162ac3331fa1', 'request_id': 'req-8922093b-89c2-448e-ad69-6a88731c59b8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.694773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] The token cache is being invalidate because project f3c2bc9864834a1c910a162ac3331fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:23.695048 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.695960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8922093b-89c2-448e-ad69-6a88731c59b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.707273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1011/2022] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:23 2022] DELETE /identity/v3/projects/f3c2bc9864834a1c910a162ac3331fa1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:23.709727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd276dc-02fb-45d4-a982-4f86194257a6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.710041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd276dc-02fb-45d4-a982-4f86194257a6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.710318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd276dc-02fb-45d4-a982-4f86194257a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.725569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43340f-1084-45c0-8d59-985c2148e975 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.732406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8fd276dc-02fb-45d4-a982-4f86194257a6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.733796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8fd276dc-02fb-45d4-a982-4f86194257a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.790665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.791723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.792818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.793277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.796339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.830762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1012/2023] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.832373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.832963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.833455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.854307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.855866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.870247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1013/2024] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.877931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.886790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.889027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd2520-543b-4524-bcc2-659ab61c12db service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.892267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162f60-c307-4d32-99a9-a357c4a076ed None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.900865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.901544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.902208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.902208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.902830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:23.903140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.906941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.911061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1012/2025] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:23.912714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.913003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.913287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.918920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1014/2026] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:23.923529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.935019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955895d6-b826-4e1c-91b4-ecda6efb7fd2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.935603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.937604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.942213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.943263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.943828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.944393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.945520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.947988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.952712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1013/2027] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.957099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.979593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76711637-a3b0-4dba-af02-e6800067a947 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.990294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.990985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.991272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.991552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.992333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:23.992648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.996480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.013106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1015/2028] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:24.029571 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.051203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1014/2029] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:24.052297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.053336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.087069 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5813d-2234-4afa-af31-bea6c82f31d7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.195129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.200457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bf9b2-32ef-4dee-934d-584017ac8bae admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.209392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.210003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.210293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.210575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.212285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.214723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.224555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.225640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.226673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.227178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.228824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.231537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.246309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1016/2030] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:24.247243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.262317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e402e32-6c15-4095-a690-cea0797ab015 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.267831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.268692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.268981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.269262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.270213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.272098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.288547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1015/2031] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:24.293448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1017/2032] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:24.294504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.294625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.307683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2c6d8-4caa-46af-b145-cb0ba24e324b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.412848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.413618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.413912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.414198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.415326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.417419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.437219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47f9c4-5888-4068-b665-00d754977a17 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.447709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.449246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.449564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.449850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.451830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.458263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1018/2033] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:24.458263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.459483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.462107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.478273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856b8b-032e-48be-961e-b5f7d80ccdcf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.484157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1016/2034] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:24.486755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.496150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.497100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.497393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.497677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] PATH_INFO: `/v3/projects/bfa3bd27569f4e0d9c33474454c50d19` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.500401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa3bd27569f4e0d9c33474454c50d19)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.502742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.508802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e689e03-6efa-4cc6-ba2b-a06ce7398463 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.527152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.528028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.528350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.528634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.529396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.531930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.547674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1017/2035] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:24.547674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.563917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07c95b-5ca1-4891-8ec4-51122cc92dae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.568643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa3bd27569f4e0d9c33474454c50d19', 'request_id': 'req-58986b19-375c-4dfa-84d8-458fc4f5de15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:24.576568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa3bd27569f4e0d9c33474454c50d19', 'request_id': 'req-58986b19-375c-4dfa-84d8-458fc4f5de15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:24.587240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa3bd27569f4e0d9c33474454c50d19', 'request_id': 'req-58986b19-375c-4dfa-84d8-458fc4f5de15'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:24.601052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] The token cache is being invalidate because project bfa3bd27569f4e0d9c33474454c50d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:24.601466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:24.602352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:24.604190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1019/2036] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:24 2022] DELETE /identity/v3/projects/bfa3bd27569f4e0d9c33474454c50d19 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:24.605145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.609449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.615903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.646730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a1c72-61f1-4f47-8b01-30ae4f1c3d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.648210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1c72-61f1-4f47-8b01-30ae4f1c3d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.648654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1c72-61f1-4f47-8b01-30ae4f1c3d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.649945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1c72-61f1-4f47-8b01-30ae4f1c3d3e admin admin] PATH_INFO: `/v3/projects/e72302656f9e49c5afa66979bb2b655a/users/cc3a5756265349059550521a25877214/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.670172 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a1c72-61f1-4f47-8b01-30ae4f1c3d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72302656f9e49c5afa66979bb2b655a, user_id=cc3a5756265349059550521a25877214, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.673259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a1c72-61f1-4f47-8b01-30ae4f1c3d3e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.696879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986b19-375c-4dfa-84d8-458fc4f5de15 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.704887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1018/2037] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:24 2022] PUT /identity/v3/projects/e72302656f9e49c5afa66979bb2b655a/users/cc3a5756265349059550521a25877214/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:24.706432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.706724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.707011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.727939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:24.729211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.771908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.793294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5fc92-e4fc-4118-a648-4508c1cb1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.793980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5fc92-e4fc-4118-a648-4508c1cb1acd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.794268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5fc92-e4fc-4118-a648-4508c1cb1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.794553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5fc92-e4fc-4118-a648-4508c1cb1acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.795296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5fc92-e4fc-4118-a648-4508c1cb1acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.797179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5fc92-e4fc-4118-a648-4508c1cb1acd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.810353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1020/2038] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:24.813277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966461e-71a2-4192-99ab-9f4c373c0cac None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.813586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966461e-71a2-4192-99ab-9f4c373c0cac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.813868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966461e-71a2-4192-99ab-9f4c373c0cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.840322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1019/2039] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:24.842049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.854725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5966461e-71a2-4192-99ab-9f4c373c0cac None None] MFA Rules not processed for user `cc3a5756265349059550521a25877214`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:24.856144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5966461e-71a2-4192-99ab-9f4c373c0cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.864702 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5f32-c457-4816-a5b2-d7de840a2f2f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.896188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116453b-0f79-46ee-a303-bf0c1d8e1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.897022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116453b-0f79-46ee-a303-bf0c1d8e1248 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.897308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116453b-0f79-46ee-a303-bf0c1d8e1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.897590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116453b-0f79-46ee-a303-bf0c1d8e1248 admin admin] PATH_INFO: `/v3/projects/71e7e060268c4ba7b80ed8de81a5a593/users/7b5016ba866a49de8d1e65965f19c322/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.920570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116453b-0f79-46ee-a303-bf0c1d8e1248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e7e060268c4ba7b80ed8de81a5a593, user_id=7b5016ba866a49de8d1e65965f19c322, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.925232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116453b-0f79-46ee-a303-bf0c1d8e1248 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.946939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1020/2040] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:24 2022] PUT /identity/v3/projects/71e7e060268c4ba7b80ed8de81a5a593/users/7b5016ba866a49de8d1e65965f19c322/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:24.948727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.949351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.949748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.961827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1021/2041] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:24.963260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.963683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.963817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.977022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:24.978790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.008519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] MFA Rules not processed for user `7b5016ba866a49de8d1e65965f19c322`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:25.010157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.086227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:25.132365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1021/2042] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:25.132365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.133115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.141985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1022/2043] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:25.142863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.174861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7791b5-e5ee-4116-ad76-5f0a10d9d32f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.187418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.188473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.189906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.190380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.193676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:25.194417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.196633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.223142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1023/2044] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:25.228182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.240028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5346-65e1-4438-8b4d-2153e8dcf7df admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.241137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b140d3-31f5-4da1-8edd-cb72465f4ea5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.245211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.245889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.246154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.246280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.246453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.247387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.247879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.248368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.249372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.252254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.291986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1024/2045] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:25 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:25.293388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.295285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.328881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.330462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.342157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1022/2046] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:25.343910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.349818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:25.368932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155860c-33b9-48bf-8476-867e719bde5c service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.385382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b70a03-4520-4ab6-b7e5-7b635733eabc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.390931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.391598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.391895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.392219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.463826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.464597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.464837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.465118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.465817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.468452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.484322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.490482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.515150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1025/2047] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:25.516462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1023/2048] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:25 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:25.520506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.520873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.522879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.542966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ead9-77a7-4aed-91c9-75d1390af042 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.543711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746e38e-e83e-4611-8beb-cd7dbddad45e service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.551985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.553440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.553949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.554555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] PATH_INFO: `/v3/users/cc3a5756265349059550521a25877214` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.556279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3a5756265349059550521a25877214)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.556910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.558453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.559305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.559680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.561704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.562820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.566568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.599022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1024/2049] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:25.602202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.629288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c98ce-2214-44e5-8efe-b567a47188b1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.647651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.648199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:25.649111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.649515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.649816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.650770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.652940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.658911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3a5756265349059550521a25877214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.662454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3a5756265349059550521a25877214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.685415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3a5756265349059550521a25877214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.705164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3a5756265349059550521a25877214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.714526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1025/2050] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:25.716147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.719853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.720677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a4c7d1ca-a826-4cdb-98f6-f0d18b74b5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3a5756265349059550521a25877214'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.730917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1026/2051] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:25 2022] DELETE /identity/v3/users/cc3a5756265349059550521a25877214 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:25.735460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.735824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.736211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.753277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716aa01-13d2-4c37-8f2e-681108344fe0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.777258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:25.778508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.886027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e621d-4611-44eb-a73f-bad6a6ec3921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.887280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e621d-4611-44eb-a73f-bad6a6ec3921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.887606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e621d-4611-44eb-a73f-bad6a6ec3921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.887980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e621d-4611-44eb-a73f-bad6a6ec3921 admin admin] PATH_INFO: `/v3/projects/de3aac603dc34b6eaf895367bbe0c8f5/users/4e54e46c74d6470dbf37ebf739730414/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.908713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e621d-4611-44eb-a73f-bad6a6ec3921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3aac603dc34b6eaf895367bbe0c8f5, user_id=4e54e46c74d6470dbf37ebf739730414, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.910717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1027/2052] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:25.917062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e621d-4611-44eb-a73f-bad6a6ec3921 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.947690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.949981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.950721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1026/2053] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:25 2022] PUT /identity/v3/projects/de3aac603dc34b6eaf895367bbe0c8f5/users/4e54e46c74d6470dbf37ebf739730414/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:25.952551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.952938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.953945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.989528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] MFA Rules not processed for user `4e54e46c74d6470dbf37ebf739730414`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:25.991143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.061579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:26.104892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1027/2054] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:26.109560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c758c-b5ef-4a54-8c54-3efc84a2ff29 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.112636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.114067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.177008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12377-4633-4baf-aa0f-6b21e61237b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.177662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12377-4633-4baf-aa0f-6b21e61237b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.177946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12377-4633-4baf-aa0f-6b21e61237b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.178230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12377-4633-4baf-aa0f-6b21e61237b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.182974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c926-2b62-40af-b03a-6e96319eaf29 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.188386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.191112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.191631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.192266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.207181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.208717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:26.209109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.224471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1028/2055] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:26.252537 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf12377-4633-4baf-aa0f-6b21e61237b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.254156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf12377-4633-4baf-aa0f-6b21e61237b1 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.256089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.266486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1028/2056] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:26.267923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960bf63-f118-4fd4-95e9-e1bd4cd7afa2 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.272838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.273708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.274422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.274422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] PATH_INFO: `/v3/users/4e54e46c74d6470dbf37ebf739730414` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.275958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e54e46c74d6470dbf37ebf739730414)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.278994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.340330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e54e46c74d6470dbf37ebf739730414'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.341152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e54e46c74d6470dbf37ebf739730414'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.362557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e54e46c74d6470dbf37ebf739730414'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.371684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e54e46c74d6470dbf37ebf739730414'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.381691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e54e46c74d6470dbf37ebf739730414'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.394776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1029/2057] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:26 2022] DELETE /identity/v3/users/4e54e46c74d6470dbf37ebf739730414 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:26.400657 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.401165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.401335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.423990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:26.425398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.515230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1029/2058] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:26.530963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.533922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.598826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7659-a061-4a5b-977b-c63f6ae9347a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.602955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40568fc-dd5d-4eaf-b6e5-ae2eb24b4cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.603701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40568fc-dd5d-4eaf-b6e5-ae2eb24b4cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.604223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40568fc-dd5d-4eaf-b6e5-ae2eb24b4cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.604571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40568fc-dd5d-4eaf-b6e5-ae2eb24b4cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.616559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40568fc-dd5d-4eaf-b6e5-ae2eb24b4cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.618141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40568fc-dd5d-4eaf-b6e5-ae2eb24b4cc1 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.625971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:26.632714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1030/2059] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:26.721399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.723194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.740530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9ed7e-2826-4fcb-a220-5660bab41575 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.759104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.760055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.760377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.760653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] PATH_INFO: `/v3/projects/e72302656f9e49c5afa66979bb2b655a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.761845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72302656f9e49c5afa66979bb2b655a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.763879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.824281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72302656f9e49c5afa66979bb2b655a', 'request_id': 'req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.833098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72302656f9e49c5afa66979bb2b655a', 'request_id': 'req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.846016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72302656f9e49c5afa66979bb2b655a', 'request_id': 'req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.891366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] The token cache is being invalidate because project e72302656f9e49c5afa66979bb2b655a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:26.891835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.893104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b395c4-8b51-4ba9-9343-9ee2adf72de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.894503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1030/2060] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:26 2022] DELETE /identity/v3/projects/e72302656f9e49c5afa66979bb2b655a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:26.899348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.899636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.899919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.928890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:26.930168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.996246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1031/2061] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:27.004439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.004790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.005074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.024757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.024905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.026302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.028999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.057076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1031/2062] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:27.058256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.064781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59e70-6d54-46bd-b392-12385c27f15a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.071442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.072350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.072711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.073066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] PATH_INFO: `/v3/projects/de3aac603dc34b6eaf895367bbe0c8f5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.076317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3aac603dc34b6eaf895367bbe0c8f5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.078383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.082148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70b487-53d4-4808-bfc7-78042768edbf None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.089763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.090787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.091257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.091824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.095798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:27.096355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.099304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.120169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1032/2063] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:27.121640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.137497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75dff2-caaa-45ee-9a4a-a62310013165 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.161407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3aac603dc34b6eaf895367bbe0c8f5', 'request_id': 'req-8a06ca13-1d18-4347-9227-33f70a388605'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:27.173620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3aac603dc34b6eaf895367bbe0c8f5', 'request_id': 'req-8a06ca13-1d18-4347-9227-33f70a388605'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:27.187206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3aac603dc34b6eaf895367bbe0c8f5', 'request_id': 'req-8a06ca13-1d18-4347-9227-33f70a388605'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:27.191755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:27.220831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] The token cache is being invalidate because project de3aac603dc34b6eaf895367bbe0c8f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:27.223431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:27.225887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8a06ca13-1d18-4347-9227-33f70a388605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:27.230185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1032/2064] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:27 2022] DELETE /identity/v3/projects/de3aac603dc34b6eaf895367bbe0c8f5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:27.235517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e1b5-7a0e-437e-af37-7951d6c7be02 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.236363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e1b5-7a0e-437e-af37-7951d6c7be02 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.236363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e1b5-7a0e-437e-af37-7951d6c7be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.268398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.269317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.269817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.270187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.271663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.274878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3d51e1b5-7a0e-437e-af37-7951d6c7be02 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.276916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.278578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3d51e1b5-7a0e-437e-af37-7951d6c7be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.314273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1033/2065] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:27.324153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.324748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.325011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.345119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1033/2066] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:27.347800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.357820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.364792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.367579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.523250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1034/2067] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:27.526551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.538206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf21713-d96f-4676-856a-02f8238ce9dd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.543618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.551651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.552146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.552567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.553679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:27.554002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.555936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.570393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1035/2068] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:27.575957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.587389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:27.597445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e923687-d792-46e2-8d72-944a1a323c9d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.599339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932d3e4-077e-4392-8682-6c2a3f5e6e91 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.605996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.607195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.607581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.608844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.609983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.612146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.614232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.614924 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.615211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.615878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.616619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.618566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.653291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1036/2069] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/projects => generated 397 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:27.658257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.666054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1034/2070] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:27.671181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.684221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00bf0e-c43f-4ac6-a8ee-dac5b2f62b91 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.738435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f25f0-100d-45ee-9fc1-3168714eccac admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.743451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.744166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.745108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.745398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.746288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.748269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.762630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.763502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.763773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.764036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.765012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.767060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.777839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1037/2071] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:27.782254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.784219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1035/2072] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:27.789049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.797370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2982-1429-4ac4-8ac1-fcbdf485cbc5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.803165 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02b8a-7cf4-4742-98c4-9349769f817f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.803361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.803863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.804359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.804758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.805545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.807282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.809217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.810008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.810297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.810583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.811986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.813931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.819589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1038/2073] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:27.823591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.832101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1036/2074] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:27.834983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.844517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17990543-89ce-4088-a5dd-5b0da70eac8b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.846352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d86f9-5ed9-4d0b-a0fa-9353e430fac6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.850117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.850894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.851144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.851448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.852256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.853856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.857285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165936b-6498-477a-a806-f1b572daaa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.858751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165936b-6498-477a-a806-f1b572daaa2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.859036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165936b-6498-477a-a806-f1b572daaa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.865158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165936b-6498-477a-a806-f1b572daaa2e admin admin] PATH_INFO: `/v3/projects/b0d2e8ddc0a144c0badf2c98a25337d5/users/e354552b095f45a4ab3eb5d0c8bdedf8/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.874737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1039/2075] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:27.874737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.884808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102332aa-b0f8-4b9e-9e37-7462022c8297 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.891063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe29f2-f0b9-45c0-8b3c-ef2c16210659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.892858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe29f2-f0b9-45c0-8b3c-ef2c16210659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.893407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165936b-6498-477a-a806-f1b572daaa2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d2e8ddc0a144c0badf2c98a25337d5, user_id=e354552b095f45a4ab3eb5d0c8bdedf8, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.893519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe29f2-f0b9-45c0-8b3c-ef2c16210659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.893775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe29f2-f0b9-45c0-8b3c-ef2c16210659 admin admin] PATH_INFO: `/v3/projects/e008aa8003584783ae2d334643319d44/users/5f1903c0b8ce4e4a973920a188a2febb/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.897605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165936b-6498-477a-a806-f1b572daaa2e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.913110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe29f2-f0b9-45c0-8b3c-ef2c16210659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e008aa8003584783ae2d334643319d44, user_id=5f1903c0b8ce4e4a973920a188a2febb, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.915150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1037/2076] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:27 2022] PUT /identity/v3/projects/b0d2e8ddc0a144c0badf2c98a25337d5/users/e354552b095f45a4ab3eb5d0c8bdedf8/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:27.917204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe29f2-f0b9-45c0-8b3c-ef2c16210659 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.926085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.926496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.926779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.943879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1040/2077] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:27 2022] PUT /identity/v3/projects/e008aa8003584783ae2d334643319d44/users/5f1903c0b8ce4e4a973920a188a2febb/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:27.944800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:27.945765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.946514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.946926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.958982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] MFA Rules not processed for user `e354552b095f45a4ab3eb5d0c8bdedf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.960231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.988827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] MFA Rules not processed for user `5f1903c0b8ce4e4a973920a188a2febb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.990929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:28.042986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1038/2078] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:28.054899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:28.056295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:28.062172 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1041/2079] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:28.075062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:28.077253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:28.098919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:28.143798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ac63-a258-42a5-9600-57e5b2bee64f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:28.147576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b10b3-bbdb-4dbd-9755-cc1220316acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:28.148278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b10b3-bbdb-4dbd-9755-cc1220316acd service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:28.154716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b10b3-bbdb-4dbd-9755-cc1220316acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:28.154716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b10b3-bbdb-4dbd-9755-cc1220316acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:28.157646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e6c4-87be-4a3b-97aa-788c0e7df72f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:28.161880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:28.162614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:28.162966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:28.163343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:28.173747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:28.174215 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b10b3-bbdb-4dbd-9755-cc1220316acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:28.175406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:28.175683 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b10b3-bbdb-4dbd-9755-cc1220316acd service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:28.185707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1039/2080] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:28.186211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1042/2081] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:33.423835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:33.488170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011f5ef-4aac-4e2f-af5f-dbe73ff450d2 service glance] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:33.493467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:33.494391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:33.494674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:33.495002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] PATH_INFO: `/v3/users/5f1903c0b8ce4e4a973920a188a2febb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:33.496302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1903c0b8ce4e4a973920a188a2febb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:33.498291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:33.515966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:33.548160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1903c0b8ce4e4a973920a188a2febb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.548767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1903c0b8ce4e4a973920a188a2febb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.560824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1903c0b8ce4e4a973920a188a2febb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.574487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1903c0b8ce4e4a973920a188a2febb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.582498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1903c0b8ce4e4a973920a188a2febb'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.589879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1040/2082] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:33 2022] DELETE /identity/v3/users/5f1903c0b8ce4e4a973920a188a2febb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:33.594985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:33.595485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:33.595586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:33.613572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:33.614796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:33.682801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1043/2083] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:33.699921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:33.705173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:33.791115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7912ec5-de74-4037-994f-c1aa6415f259 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:33.795173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3985-ef29-4989-8fe2-c2cab221554a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:33.795886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3985-ef29-4989-8fe2-c2cab221554a service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:33.796229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3985-ef29-4989-8fe2-c2cab221554a service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:33.796511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3985-ef29-4989-8fe2-c2cab221554a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:33.806463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e3985-ef29-4989-8fe2-c2cab221554a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:33.807890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e3985-ef29-4989-8fe2-c2cab221554a service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:33.819452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1041/2084] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:34.781499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:34.783341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:34.797994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f28a1-64b9-4abc-bc68-0c056ca9c9d3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:34.803111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:34.804189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:34.804625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:34.805119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] PATH_INFO: `/v3/projects/e008aa8003584783ae2d334643319d44` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:34.806447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e008aa8003584783ae2d334643319d44)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:34.808665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:34.896813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e008aa8003584783ae2d334643319d44', 'request_id': 'req-b4ab6f83-a38f-4ace-8839-085ed6dc7057'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:34.903281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e008aa8003584783ae2d334643319d44', 'request_id': 'req-b4ab6f83-a38f-4ace-8839-085ed6dc7057'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:34.913031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e008aa8003584783ae2d334643319d44', 'request_id': 'req-b4ab6f83-a38f-4ace-8839-085ed6dc7057'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:34.926869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] The token cache is being invalidate because project e008aa8003584783ae2d334643319d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:34.927194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:34.927832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b4ab6f83-a38f-4ace-8839-085ed6dc7057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:34.929713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1044/2085] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:34 2022] DELETE /identity/v3/projects/e008aa8003584783ae2d334643319d44 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:37.531560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121bea-24a3-47cb-a25a-977cf1783319 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:37.532143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121bea-24a3-47cb-a25a-977cf1783319 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:37.532317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121bea-24a3-47cb-a25a-977cf1783319 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:37.533875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1042/2086] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:54:37.567941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:37.568554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:37.568653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:37.591297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] MFA Rules not processed for user `005d2ffd11584aaca47ba71a8bc2811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:37.593212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:37.599584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121bea-24a3-47cb-a25a-977cf1783319 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:37.601412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ba121bea-24a3-47cb-a25a-977cf1783319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:37.640089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:37.669737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1045/2087] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:37.681370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:37.681590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121bea-24a3-47cb-a25a-977cf1783319 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:37.682719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:37.686778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:37.687573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:37.687859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:37.688175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] PATH_INFO: `/v3/users/c6d14aec58b54f0ab7c744fc4afed7bc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:37.689403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d14aec58b54f0ab7c744fc4afed7bc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:37.692315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:37.697312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5bff4-fbdb-46b4-ade4-09d9fb2b5604 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:37.704126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:37.704786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:37.705076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:37.705401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:37.718663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:37.720309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:37.733322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1046/2088] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:37.743926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:37.751614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d14aec58b54f0ab7c744fc4afed7bc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:37.752977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d14aec58b54f0ab7c744fc4afed7bc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:37.768469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d14aec58b54f0ab7c744fc4afed7bc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:37.775639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d14aec58b54f0ab7c744fc4afed7bc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:37.783238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-bffaa759-b945-47f7-806e-106ee6363674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d14aec58b54f0ab7c744fc4afed7bc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:37.790102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1043/2089] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:37 2022] DELETE /identity/v3/users/c6d14aec58b54f0ab7c744fc4afed7bc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:37.972614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:37.998047 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4f81d-54f6-4676-b5c7-2b91a6174830 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.067653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.068644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.068934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.069214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] PATH_INFO: `/v3/projects/72c32088fd59410c8bd6ba9e896d046f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.070775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c32088fd59410c8bd6ba9e896d046f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.072788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.131282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c32088fd59410c8bd6ba9e896d046f', 'request_id': 'req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.140986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c32088fd59410c8bd6ba9e896d046f', 'request_id': 'req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.153629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c32088fd59410c8bd6ba9e896d046f', 'request_id': 'req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.176104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] The token cache is being invalidate because project 72c32088fd59410c8bd6ba9e896d046f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:38.176909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.177945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.180048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1047/2090] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:37 2022] DELETE /identity/v3/projects/72c32088fd59410c8bd6ba9e896d046f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:38.185524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b2b5-43b4-482a-8ebd-2a50b6e5fce7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.186419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b2b5-43b4-482a-8ebd-2a50b6e5fce7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.186962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b2b5-43b4-482a-8ebd-2a50b6e5fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.214973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9b04b2b5-43b4-482a-8ebd-2a50b6e5fce7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:38.216379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9b04b2b5-43b4-482a-8ebd-2a50b6e5fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.238434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.240923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.316002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1044/2091] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:38.333699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.333699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.333699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.354943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:38.370853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8bf8-22f0-4826-a8cd-9ab59301a8ab admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.382411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:38.385038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.389967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.390871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.391160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.391420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] PATH_INFO: `/v3/users/7b5016ba866a49de8d1e65965f19c322` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.393507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5016ba866a49de8d1e65965f19c322)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.401318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.423085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1045/2092] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:38.427753 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.438891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25421b3a-cc42-4be2-be5f-75f4b89997de None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.445321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.445708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.445989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.446671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.447415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:38.447791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.449876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.481442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1046/2093] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:38.489472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.507182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2acd0-4b1b-4d97-bff1-4408fc5dd83b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.513574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.514714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.515054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.515394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.516416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.520366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5016ba866a49de8d1e65965f19c322'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.521065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5016ba866a49de8d1e65965f19c322'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.531332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.536722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5016ba866a49de8d1e65965f19c322'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.546402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5016ba866a49de8d1e65965f19c322'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.559689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-48fa1918-6391-4224-8991-4815e2647c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5016ba866a49de8d1e65965f19c322'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:38.573083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1048/2094] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:38 2022] DELETE /identity/v3/users/7b5016ba866a49de8d1e65965f19c322 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:38.579136 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.579618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.580096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.586583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1047/2095] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:38.590870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.594320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.602233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:38.603742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.675993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1049/2096] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:38.679205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660359a6-43a5-489f-b7fc-4a32fc414e36 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.685025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.686159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.686499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.686768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.689363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.689489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.689572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.692309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.711368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1048/2097] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:38.715361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.722044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:38.726394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb905f13-fc2c-41fd-af41-a6c2eb516887 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.733702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.734747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.735084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.735360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.736113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.738131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.749751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1049/2098] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:38.753637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.755245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bf72b-fb17-4a7d-b88a-09746fac27de None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.758851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.759488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.759772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.760055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.763151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e184-2320-4371-8c55-694c7ea19959 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.768942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76eaa-87c8-44b7-9bcc-bf11138d2b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.769594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76eaa-87c8-44b7-9bcc-bf11138d2b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.769996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76eaa-87c8-44b7-9bcc-bf11138d2b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.770336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76eaa-87c8-44b7-9bcc-bf11138d2b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.770429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.771098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76eaa-87c8-44b7-9bcc-bf11138d2b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.771863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.772723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76eaa-87c8-44b7-9bcc-bf11138d2b94 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.783225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1050/2099] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:38.786029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1050/2100] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:38.792994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:38.803240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ffea-65ef-436c-a3fd-3ac3a6d84a90 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:38.807987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:38.808877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.809152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.809427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] PATH_INFO: `/v3/projects/2b09007ec8784207b02498a8f43451ec/users/f4b50e1186a143f9a046c3a11c0eaabf/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.824744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b09007ec8784207b02498a8f43451ec, user_id=f4b50e1186a143f9a046c3a11c0eaabf, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:38.827411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:38.829819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:38.845637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1051/2101] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:38 2022] PUT /identity/v3/projects/2b09007ec8784207b02498a8f43451ec/users/f4b50e1186a143f9a046c3a11c0eaabf/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:38.855981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:38.856313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:38.856605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:38.885937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] MFA Rules not processed for user `f4b50e1186a143f9a046c3a11c0eaabf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:38.887239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:38.968626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1051/2102] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:38.973432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.050624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c2fee-377e-4aab-8744-f5e5f4e86881 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.055829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.056880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.057168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.057448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.058157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.060461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.096148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1052/2103] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:39.100204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.112787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18beb09-ae53-4fb7-b996-5ee0ca010057 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.118932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.120953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.189869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.190617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.190932 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.191239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.191947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.193927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.199526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc9908-711b-4202-9330-1955c47f0983 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.205285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.206262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.206614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.206964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] PATH_INFO: `/v3/projects/71e7e060268c4ba7b80ed8de81a5a593` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.208262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e7e060268c4ba7b80ed8de81a5a593)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.210286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.217091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1052/2104] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:39.221415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.231587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d8388-55f8-4933-9844-81a0b2b6c977 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.237639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.238526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.238813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.239227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.240306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.242352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.254677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1053/2105] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:39.258860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.266606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e7e060268c4ba7b80ed8de81a5a593', 'request_id': 'req-c70da0ae-647a-4601-a2b5-e064eb0706b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:39.269231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2e65-3a5b-4384-bc45-ed55286c8f18 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.272442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e7e060268c4ba7b80ed8de81a5a593', 'request_id': 'req-c70da0ae-647a-4601-a2b5-e064eb0706b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:39.281478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e7e060268c4ba7b80ed8de81a5a593', 'request_id': 'req-c70da0ae-647a-4601-a2b5-e064eb0706b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:39.293256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] The token cache is being invalidate because project 71e7e060268c4ba7b80ed8de81a5a593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:39.293554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:39.294227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c70da0ae-647a-4601-a2b5-e064eb0706b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:39.296017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1053/2106] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:39 2022] DELETE /identity/v3/projects/71e7e060268c4ba7b80ed8de81a5a593 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:39.300714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915007-6c44-4640-a4b6-4f7aaca72ed2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.301002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915007-6c44-4640-a4b6-4f7aaca72ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.301284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915007-6c44-4640-a4b6-4f7aaca72ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.321894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-80915007-6c44-4640-a4b6-4f7aaca72ed2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:39.323186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-80915007-6c44-4640-a4b6-4f7aaca72ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.325625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:39.328323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:39.343513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.344556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.344922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.345271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] PATH_INFO: `/v3/projects/13d7e3e8a8604862a35711de0bbd2c71/users/caf4cc522f044bf7bd228f391ad96113/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.364963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d7e3e8a8604862a35711de0bbd2c71, user_id=caf4cc522f044bf7bd228f391ad96113, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.367082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.382410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1054/2107] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:39 2022] PUT /identity/v3/projects/13d7e3e8a8604862a35711de0bbd2c71/users/caf4cc522f044bf7bd228f391ad96113/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:39.386415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.388206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.407470 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1054/2108] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:39.416233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.416603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.416976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.440377 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:39.441607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.478398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfec776-46a5-48cd-9a24-ed5e8d53bf3d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.483547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.484335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.484622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.484899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.485636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.487592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.499608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1055/2109] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:39.505090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.517083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8d79-b41e-4e96-a126-474f1253d7c8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.526615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312a256-11b4-406c-b82a-386b90c57d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.528107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312a256-11b4-406c-b82a-386b90c57d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.528584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312a256-11b4-406c-b82a-386b90c57d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.529014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312a256-11b4-406c-b82a-386b90c57d7b admin admin] PATH_INFO: `/v3/projects/13d7e3e8a8604862a35711de0bbd2c71/users/caf4cc522f044bf7bd228f391ad96113/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.531402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312a256-11b4-406c-b82a-386b90c57d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d7e3e8a8604862a35711de0bbd2c71, user_id=caf4cc522f044bf7bd228f391ad96113, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.534237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312a256-11b4-406c-b82a-386b90c57d7b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.538869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1055/2110] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:39.543489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.550694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1056/2111] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:39 2022] PUT /identity/v3/projects/13d7e3e8a8604862a35711de0bbd2c71/users/caf4cc522f044bf7bd228f391ad96113/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:39.557822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6a87-935e-44ec-a569-6f53079aae87 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.561303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.561671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.561938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.585828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] MFA Rules not processed for user `12867bdde0f64629a0d6cc87b6c319fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:39.589000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.618172 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.618955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.619245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.619524 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.620277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:39.620612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.622276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11398801-20ba-4aba-9260-3c9fc4cf3cd8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.636018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1056/2112] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:39.641541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.641886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.642119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.645904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1057/2113] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:39.646833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.659327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb894-1ba9-43c1-b6f8-91aa7b2f765e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.670044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.670359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] MFA Rules not processed for user `caf4cc522f044bf7bd228f391ad96113`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:39.671599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.671780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.672323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.672814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.673834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.676447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.711093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1058/2114] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:39.715246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.716355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:39.768242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1057/2115] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:39.784690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:39.785251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.787181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:39.812482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343257-b760-4a1d-8dc9-8b4c9ed5e016 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.817838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.818553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.818855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.819325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.820135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.822547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.848250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1059/2116] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:39 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:39.852131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.861798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5282de3-5614-4dc6-8b95-d469e7cd311c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.870167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb71c7-a6d7-4c16-b0ad-30d8a57bad50 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.875126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.875796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.876106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.876402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.877133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.879134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.891376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1060/2117] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:39.895475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.906487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d6f09-de54-47a2-b97f-b69cff959024 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.914369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.915220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.915632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.915907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.917227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.919131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.932697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1061/2118] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:39.936988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.937156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:39.938199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.938636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.939060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.948297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe928-bc5a-42fb-8c60-d9ea5c22656f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:39.953562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02769f2f-fa20-4d73-b77d-58f8cdaaeaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:39.954494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769f2f-fa20-4d73-b77d-58f8cdaaeaed admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:39.954775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769f2f-fa20-4d73-b77d-58f8cdaaeaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:39.955094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02769f2f-fa20-4d73-b77d-58f8cdaaeaed admin admin] PATH_INFO: `/v3/projects/e7875545154740fca1737845d575e005/users/1955c9117da04a328cc134e2cb4dfcfe/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:39.973542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769f2f-fa20-4d73-b77d-58f8cdaaeaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7875545154740fca1737845d575e005, user_id=1955c9117da04a328cc134e2cb4dfcfe, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:39.977106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02769f2f-fa20-4d73-b77d-58f8cdaaeaed admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:39.993811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1062/2119] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:39 2022] PUT /identity/v3/projects/e7875545154740fca1737845d575e005/users/1955c9117da04a328cc134e2cb4dfcfe/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:40.005856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.006545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.006545 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.021275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:40.022833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:40.034848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1058/2120] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:40.038309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] MFA Rules not processed for user `1955c9117da04a328cc134e2cb4dfcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:40.039906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:40.132504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1063/2121] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:40.149279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:40.150817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:40.208731 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:40.233179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9b1e-ca0f-4087-9094-7f5ca57384bf service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:40.299413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4ac1b-29de-4fec-bc70-029ff7db4e32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:40.300230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4ac1b-29de-4fec-bc70-029ff7db4e32 service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.300600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4ac1b-29de-4fec-bc70-029ff7db4e32 service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.301090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4ac1b-29de-4fec-bc70-029ff7db4e32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.313247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4ac1b-29de-4fec-bc70-029ff7db4e32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:40.314695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4ac1b-29de-4fec-bc70-029ff7db4e32 service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:40.325113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1059/2122] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:40.544214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:40.647798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da531e-95f7-4ee5-88ba-cab186e870fa None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:40.652916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:40.653868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.654346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.655271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] PATH_INFO: `/v3/users/f4b50e1186a143f9a046c3a11c0eaabf` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.656577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b50e1186a143f9a046c3a11c0eaabf)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:40.658915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:40.680054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:40.756517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b50e1186a143f9a046c3a11c0eaabf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.757841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b50e1186a143f9a046c3a11c0eaabf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.775162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b50e1186a143f9a046c3a11c0eaabf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.792610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b50e1186a143f9a046c3a11c0eaabf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.796352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b50e1186a143f9a046c3a11c0eaabf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.805488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1064/2123] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:40 2022] DELETE /identity/v3/users/f4b50e1186a143f9a046c3a11c0eaabf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:40.810665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.811661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.811836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.833471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:40.834813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:40.927129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1060/2124] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:40.938345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:40.939825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:41.014595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7cdec-ac0c-4ba8-afd0-561cafa5e44b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:41.018287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:41.018972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:41.019257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:41.019539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:41.039405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:41.041186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:41.055128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1065/2125] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:41.357113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:41.359189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:41.374336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16149d26-bd1b-4434-9fe0-f7200de9bf56 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:41.379996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:41.382529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:41.382831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:41.383207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] PATH_INFO: `/v3/projects/2b09007ec8784207b02498a8f43451ec` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:41.384613 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b09007ec8784207b02498a8f43451ec)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:41.386712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:41.442642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b09007ec8784207b02498a8f43451ec', 'request_id': 'req-50e002e8-a8e7-4849-a983-8b5fb968c75d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.449065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b09007ec8784207b02498a8f43451ec', 'request_id': 'req-50e002e8-a8e7-4849-a983-8b5fb968c75d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.456993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b09007ec8784207b02498a8f43451ec', 'request_id': 'req-50e002e8-a8e7-4849-a983-8b5fb968c75d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.470896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] The token cache is being invalidate because project 2b09007ec8784207b02498a8f43451ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:41.471186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.471845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.473432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1061/2126] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:41 2022] DELETE /identity/v3/projects/2b09007ec8784207b02498a8f43451ec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:41.477686 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:41.488944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2f642-54c0-4bba-9505-7d0c20fff819 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:41.548769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:41.549855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:41.550149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:41.550431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] PATH_INFO: `/v3/users/caf4cc522f044bf7bd228f391ad96113` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:41.551717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf4cc522f044bf7bd228f391ad96113)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:41.553771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:41.597752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:41.607762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf4cc522f044bf7bd228f391ad96113'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.608448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf4cc522f044bf7bd228f391ad96113'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.628747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf4cc522f044bf7bd228f391ad96113'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.639449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf4cc522f044bf7bd228f391ad96113'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.650940 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2aa388f0-dfa8-4887-9ce7-295a18bc1592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf4cc522f044bf7bd228f391ad96113'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.661971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1066/2127] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:41 2022] DELETE /identity/v3/users/caf4cc522f044bf7bd228f391ad96113 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:42.126963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.128591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:42.146109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e002e8-a8e7-4849-a983-8b5fb968c75d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.163928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:42.216572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.218180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.218534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.218809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] PATH_INFO: `/v3/projects/13d7e3e8a8604862a35711de0bbd2c71` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.220235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d7e3e8a8604862a35711de0bbd2c71)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.222345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.278910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d7e3e8a8604862a35711de0bbd2c71', 'request_id': 'req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:42.285339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d7e3e8a8604862a35711de0bbd2c71', 'request_id': 'req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:42.307474 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d7e3e8a8604862a35711de0bbd2c71', 'request_id': 'req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:42.320965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] The token cache is being invalidate because project 13d7e3e8a8604862a35711de0bbd2c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:42.321591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:42.322451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7423e129-fb79-4f25-9ca0-2b6e62e33ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:42.324347 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1062/2128] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:42 2022] DELETE /identity/v3/projects/13d7e3e8a8604862a35711de0bbd2c71 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:42.330610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.330908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.331197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.351549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:42.352809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:42.422758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1067/2129] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:42.433847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.434285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.434532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.455947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:42.457334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:42.466556 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1063/2130] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:42.471116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.482361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019a387-9e2b-40cd-9c0d-1c5ce0e83bae None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.488917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.488917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.488917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.489222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.490028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:42.490385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.492164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.508588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1068/2131] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:42.513191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.523597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3d982-3fb4-4604-8202-cf1a73a59585 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.528867 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.530075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.530356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.530631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.531319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.533249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.559825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1064/2132] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:42.565368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.577636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acdd20-149c-42f4-8f2a-bc27f469f361 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.637874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.638475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.638983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.639260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.639957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.641960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.672016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1069/2133] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:42.674141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.684550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0fb2-791f-4c5e-9a99-c9f57a304f18 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.689168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.690797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.691115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.691512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.695173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.695173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.714993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1065/2134] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:42.716357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.727124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014074-e077-4367-b288-a11b50afb1c5 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.737907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc489c7-2040-4383-85d0-1fd82b6fb2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.738719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc489c7-2040-4383-85d0-1fd82b6fb2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.739098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc489c7-2040-4383-85d0-1fd82b6fb2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.739477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc489c7-2040-4383-85d0-1fd82b6fb2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.745072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc489c7-2040-4383-85d0-1fd82b6fb2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.745072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc489c7-2040-4383-85d0-1fd82b6fb2cf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.764759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1070/2135] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:42.768678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.782115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551930a6-266b-4500-99c6-39927645c3cc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.788112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.789110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.789495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.789856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] PATH_INFO: `/v3/projects/fc80dba9209c4b5eb2d30b09ede53199/users/cbf44cb8d93d44e0a27fd95f216e4914/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.805677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc80dba9209c4b5eb2d30b09ede53199, user_id=cbf44cb8d93d44e0a27fd95f216e4914, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.808488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.822306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1066/2136] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:42 2022] PUT /identity/v3/projects/fc80dba9209c4b5eb2d30b09ede53199/users/cbf44cb8d93d44e0a27fd95f216e4914/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:42.832534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.832823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.833101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.872523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] MFA Rules not processed for user `cbf44cb8d93d44e0a27fd95f216e4914`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:42.873834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:42.884540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:42.955351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1071/2137] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:42.959078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.019357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:43.037601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a6d2-1bbd-49a8-be1c-e98c8e4dbee1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.043805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.044754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.045620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.047605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.047605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.049642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.095563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1067/2138] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:43.099653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.111289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03de0b1-714c-4a25-b433-1403530f481f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.191248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.192033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.192435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.192673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.196308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.196308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.221217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1072/2139] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:43 2022] POST /identity/v3/users => generated 307 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:43.222362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.235164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737f193-9f81-4da4-be92-ef5573d51bdf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.240604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.241444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.241844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.242126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.242980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.245130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.260003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1068/2140] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:43.263901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.274944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06db347-f9d6-4382-bfc6-ee3416e63532 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.282363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.282687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.282969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.283264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] PATH_INFO: `/v3/projects/a44ca4270a364a4f8b915cbff16a083d/users/44b202db6ac14701ac332342a77f9e65/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.305573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44ca4270a364a4f8b915cbff16a083d, user_id=44b202db6ac14701ac332342a77f9e65, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.306802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.340125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1073/2141] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:43 2022] PUT /identity/v3/projects/a44ca4270a364a4f8b915cbff16a083d/users/44b202db6ac14701ac332342a77f9e65/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:43.343994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.357638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8fcf7-e2bf-40d7-bab7-01da133003b5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.426469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05c72-fbf9-4b9a-b365-2cd5ea1368c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.427218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05c72-fbf9-4b9a-b365-2cd5ea1368c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.427516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05c72-fbf9-4b9a-b365-2cd5ea1368c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.427794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05c72-fbf9-4b9a-b365-2cd5ea1368c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.428565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d05c72-fbf9-4b9a-b365-2cd5ea1368c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.430196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d05c72-fbf9-4b9a-b365-2cd5ea1368c3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.440384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1069/2142] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:43.444603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.455226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e3a24-8076-45cb-b969-d7d026800c27 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.460019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.460994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.461346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.461709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] PATH_INFO: `/v3/projects/a44ca4270a364a4f8b915cbff16a083d/users/44b202db6ac14701ac332342a77f9e65/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.463895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44ca4270a364a4f8b915cbff16a083d, user_id=44b202db6ac14701ac332342a77f9e65, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.468116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.479561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1074/2143] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:43 2022] PUT /identity/v3/projects/a44ca4270a364a4f8b915cbff16a083d/users/44b202db6ac14701ac332342a77f9e65/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:43.490777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.491214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.491599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.520975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] MFA Rules not processed for user `44b202db6ac14701ac332342a77f9e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:43.522205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:43.600196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1070/2144] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:43.612206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.613895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:43.678304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0ac70-0918-46b6-9213-1b1731b5f81a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.683660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.684593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.684913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.685208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.696862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.698350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.709189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1075/2145] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:43.803471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.804997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:43.817475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97bbbe-65db-4130-8eec-d1a022db8271 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.821728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5448c5-d9ba-40b1-ab20-0594036e601b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.822398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5448c5-d9ba-40b1-ab20-0594036e601b service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.822734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5448c5-d9ba-40b1-ab20-0594036e601b service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.823030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5448c5-d9ba-40b1-ab20-0594036e601b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.871305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:43.899694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5448c5-d9ba-40b1-ab20-0594036e601b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.901282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5448c5-d9ba-40b1-ab20-0594036e601b service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.910980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1071/2146] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:48.133312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:48.139263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:48.196906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5882a55-18bb-46da-aad7-9f8a9202e364 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:48.202247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:48.203169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:48.203477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:48.203754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] PATH_INFO: `/v3/users/cbf44cb8d93d44e0a27fd95f216e4914` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:48.205011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf44cb8d93d44e0a27fd95f216e4914)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:48.207021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:48.256282 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf44cb8d93d44e0a27fd95f216e4914'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.256935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf44cb8d93d44e0a27fd95f216e4914'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.269625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf44cb8d93d44e0a27fd95f216e4914'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.277026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf44cb8d93d44e0a27fd95f216e4914'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.284468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf44cb8d93d44e0a27fd95f216e4914'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.290620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1076/2147] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:48 2022] DELETE /identity/v3/users/cbf44cb8d93d44e0a27fd95f216e4914 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:48.296163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:48.296639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:48.296853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:48.316413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:48.317622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:48.383882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1072/2148] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:48.393764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:48.395239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:48.453780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963155fa-8e24-4a21-b0b1-1690053cc997 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:48.457513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:48.458168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:48.458452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:48.458730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:48.468499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:48.469931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:48.479701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1077/2149] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:48.771493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:48.773487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:48.789445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d33b-1b84-44b7-a92a-fafb5aa8b7b8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:48.794216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:48.795920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:48.796578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:48.796881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] PATH_INFO: `/v3/projects/fc80dba9209c4b5eb2d30b09ede53199` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:48.798154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc80dba9209c4b5eb2d30b09ede53199)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:48.800035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:48.853604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc80dba9209c4b5eb2d30b09ede53199', 'request_id': 'req-5d25c605-693e-4a4d-9637-4600f004baef'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.868775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc80dba9209c4b5eb2d30b09ede53199', 'request_id': 'req-5d25c605-693e-4a4d-9637-4600f004baef'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.879863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc80dba9209c4b5eb2d30b09ede53199', 'request_id': 'req-5d25c605-693e-4a4d-9637-4600f004baef'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.892276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] The token cache is being invalidate because project fc80dba9209c4b5eb2d30b09ede53199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:48.892572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.893229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:48.894985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1073/2150] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:48 2022] DELETE /identity/v3/projects/fc80dba9209c4b5eb2d30b09ede53199 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:48.899002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:48.911494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea8161-494a-4481-8860-20655a323134 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:48.940241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:48.981021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:48.982006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:48.982833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:48.983141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] PATH_INFO: `/v3/users/44b202db6ac14701ac332342a77f9e65` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:48.984445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b202db6ac14701ac332342a77f9e65)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:48.986514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:49.040574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b202db6ac14701ac332342a77f9e65'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.041446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b202db6ac14701ac332342a77f9e65'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.076455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b202db6ac14701ac332342a77f9e65'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.084387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b202db6ac14701ac332342a77f9e65'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.094586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6eb97a34-74c3-4f11-a9af-31ac5f9dd582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b202db6ac14701ac332342a77f9e65'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.112133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1078/2151] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:48 2022] DELETE /identity/v3/users/44b202db6ac14701ac332342a77f9e65 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:49.579018 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:49.580557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:49.595391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c605-693e-4a4d-9637-4600f004baef admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:49.657974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:49.658896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.659174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.659447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] PATH_INFO: `/v3/projects/a44ca4270a364a4f8b915cbff16a083d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.660676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44ca4270a364a4f8b915cbff16a083d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:49.662568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:49.664893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:49.714246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44ca4270a364a4f8b915cbff16a083d', 'request_id': 'req-37fc8430-7c18-43d5-b28a-59f54f26f2b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.720858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44ca4270a364a4f8b915cbff16a083d', 'request_id': 'req-37fc8430-7c18-43d5-b28a-59f54f26f2b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.732000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44ca4270a364a4f8b915cbff16a083d', 'request_id': 'req-37fc8430-7c18-43d5-b28a-59f54f26f2b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.745234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] The token cache is being invalidate because project a44ca4270a364a4f8b915cbff16a083d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:49.745392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.746190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-37fc8430-7c18-43d5-b28a-59f54f26f2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.747926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1074/2152] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:49 2022] DELETE /identity/v3/projects/a44ca4270a364a4f8b915cbff16a083d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:49.753445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.753961 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.754071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.774057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:49.775401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:49.838346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1079/2153] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:49.846258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.846552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.846859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.879016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:49.880378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:49.889284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1075/2154] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:49.893983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:49.903766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af735a07-203e-4378-bffc-237c3e9608bb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:49.908398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:49.909061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.909344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.909626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.910351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:49.910659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:49.912281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:49.924627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1080/2155] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:49.929290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:49.939284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942377d-7c19-4f64-af29-a7b67d2e4f05 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:49.944123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:49.944780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.945064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.945344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.946301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:49.948248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:49.978418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1076/2156] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:49 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:49.979847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:49.990535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edce4a-2ec1-41f3-99de-146e784ccb3d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.020955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:50.051443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.052144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.052423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.052698 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.053394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.055365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.078281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1081/2157] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:49 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:50.082960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.098319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054a8a4-db64-46ba-9686-0f76a72f11c6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.102945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.103607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.103884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.104188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.104916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.106495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.116741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1077/2158] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:50.121555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.133149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b348-d91a-4341-89f3-92795210ce19 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.139555 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ecb08-880a-4297-9260-fd23533a69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.140500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ecb08-880a-4297-9260-fd23533a69e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.140800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ecb08-880a-4297-9260-fd23533a69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.141110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ecb08-880a-4297-9260-fd23533a69e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.142082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ecb08-880a-4297-9260-fd23533a69e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.143977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ecb08-880a-4297-9260-fd23533a69e9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.155799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1082/2159] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:50.159950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.170849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6f410-8296-43e2-9259-7d6cf9e1189c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.175723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.176651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.176910 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.177184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] PATH_INFO: `/v3/projects/d66d9460817f4c08aa2403eefb1d7b68/users/a34648fc19bd43d0ad0db287fbbff59d/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.191906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66d9460817f4c08aa2403eefb1d7b68, user_id=a34648fc19bd43d0ad0db287fbbff59d, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.194785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.209432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1078/2160] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:50 2022] PUT /identity/v3/projects/d66d9460817f4c08aa2403eefb1d7b68/users/a34648fc19bd43d0ad0db287fbbff59d/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:50.219379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.219675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.219981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.246927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] MFA Rules not processed for user `a34648fc19bd43d0ad0db287fbbff59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:50.248972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.314091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1083/2161] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:50.318512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.382078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6b71-f4f9-4b01-8f27-5bb1901be291 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.386786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.387435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.387715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.387988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.389193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.391087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.417734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1079/2162] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:50.423075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.433828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6e08-f145-4e1e-905e-cbb641f93457 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.509547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.519450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.519756 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.520024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.520789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.522877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.528565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.533083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.549796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feddde-e3df-4542-b2d4-8c18a5f49b6a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.556218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1084/2163] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:50.558648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.559598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.559890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.560244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] PATH_INFO: `/v3/users/e354552b095f45a4ab3eb5d0c8bdedf8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.561303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.561597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e354552b095f45a4ab3eb5d0c8bdedf8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.563645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.570359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:50.574764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d0816-e56a-4189-9cff-f4d9a5f4223f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.581358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.582031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.582719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.583101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.584083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.585899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.599521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1085/2164] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:50.603647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.614134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2d19-f0d4-4288-b716-28ae9ede6dad admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.622696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.623814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.624162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.624485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] PATH_INFO: `/v3/projects/27c666e368804bdfbca23dea78a6986d/users/2f569b766bf7443d812cea6e659bb307/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.625547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e354552b095f45a4ab3eb5d0c8bdedf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.626247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e354552b095f45a4ab3eb5d0c8bdedf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.645458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c666e368804bdfbca23dea78a6986d, user_id=2f569b766bf7443d812cea6e659bb307, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.645697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e354552b095f45a4ab3eb5d0c8bdedf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.648199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.651741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:50.655763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e354552b095f45a4ab3eb5d0c8bdedf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.664276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-21770cd0-1dc3-4b98-89ec-86661f37d9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e354552b095f45a4ab3eb5d0c8bdedf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.665714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1086/2165] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:50 2022] PUT /identity/v3/projects/27c666e368804bdfbca23dea78a6986d/users/2f569b766bf7443d812cea6e659bb307/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:50.669829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.671003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1080/2166] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:50 2022] DELETE /identity/v3/users/e354552b095f45a4ab3eb5d0c8bdedf8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:50.672402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.675701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.676118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.676404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.694257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:50.695479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.747037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573259-f7ea-4601-861a-e09c1da100c8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.766185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1081/2167] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:50.776350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.777891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.832862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.833491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.833773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.834014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.834779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.836428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.846953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1087/2168] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:50.851015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.860918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cd4e0-4fc3-4e9d-8963-f40e2e6746fb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.862316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490df6a-b786-4381-8c2c-8aab9fcbb146 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.865857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3548-ebaa-411b-a712-4377b4898ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.866737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3548-ebaa-411b-a712-4377b4898ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.867026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3548-ebaa-411b-a712-4377b4898ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.867333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3548-ebaa-411b-a712-4377b4898ed4 admin admin] PATH_INFO: `/v3/projects/27c666e368804bdfbca23dea78a6986d/users/2f569b766bf7443d812cea6e659bb307/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.869310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.869485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3548-ebaa-411b-a712-4377b4898ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c666e368804bdfbca23dea78a6986d, user_id=2f569b766bf7443d812cea6e659bb307, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.870446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.871003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.871609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.872658 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3548-ebaa-411b-a712-4377b4898ed4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.885320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1088/2169] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:50 2022] PUT /identity/v3/projects/27c666e368804bdfbca23dea78a6986d/users/2f569b766bf7443d812cea6e659bb307/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:50.885598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.887396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.897084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.897372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.897645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.900920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1082/2170] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:50.932443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] MFA Rules not processed for user `2f569b766bf7443d812cea6e659bb307`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:50.934070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.015546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1089/2171] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:51.029048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.030900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.074716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:51.104809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548cdd-1cc0-4acf-add0-dd956eb928b3 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.167129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.167129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.167129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.167129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.178379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.179862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.190747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1083/2172] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:51.247865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.249983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.266903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:51.296510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.306989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1d17-950c-4c76-8808-3e3d62d1ae32 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.312106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.312927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.313365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.313819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.316000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.332405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e58f6b-081b-4087-8228-102d03ece5d1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.337737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.338822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.339497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.339790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] PATH_INFO: `/v3/projects/b0d2e8ddc0a144c0badf2c98a25337d5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.341086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d2e8ddc0a144c0badf2c98a25337d5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.343358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.398364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d2e8ddc0a144c0badf2c98a25337d5', 'request_id': 'req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:51.404792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d2e8ddc0a144c0badf2c98a25337d5', 'request_id': 'req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:51.413086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d2e8ddc0a144c0badf2c98a25337d5', 'request_id': 'req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:51.418706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.420779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e639fd-9f55-4180-90e4-4c0449c510c0 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.429913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] The token cache is being invalidate because project b0d2e8ddc0a144c0badf2c98a25337d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:51.430200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:51.432108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1084/2173] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:51.432776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3fd3b59c-6855-47c1-bf1b-c937e1e0ea26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:51.438848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1090/2174] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:51 2022] DELETE /identity/v3/projects/b0d2e8ddc0a144c0badf2c98a25337d5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:51.441874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.442403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.442693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.462484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:51.463974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.553872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1085/2175] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:51.562596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.562960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.563334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.588884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:51.590140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.599848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1091/2176] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:51.604514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.616224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c36efd-dc58-4fd7-a1a7-830a5b69c22b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.623079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.623814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.624197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.624540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.625355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:51.625721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.627553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.666129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1086/2177] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:51.673435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.691442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbd525-af9d-490b-8fce-e0c1d06bc14b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.699329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.700116 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.701306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.702581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.704472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.707798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.764281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1092/2178] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:51 2022] POST /identity/v3/projects => generated 359 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:51.764669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.782436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d276690-1c0c-40ee-8af2-42ec39ede8aa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.804346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:51.871877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.872710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.873129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.873506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.874324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.876380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.901617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1087/2179] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:51 2022] POST /identity/v3/users => generated 280 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:51.907021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.917877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9703-5a45-4e3c-ab84-bfe96d698a7d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.922663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.923316 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.923597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.923873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.924853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.926431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.937295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1093/2180] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:51.941703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.952741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bdc0-0229-4a1b-8337-61d6a430ae41 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.960484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d677-8702-43cf-a69a-6d899e11d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.961988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d677-8702-43cf-a69a-6d899e11d331 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.962479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d677-8702-43cf-a69a-6d899e11d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.962947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d677-8702-43cf-a69a-6d899e11d331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.964650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d677-8702-43cf-a69a-6d899e11d331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.969752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d677-8702-43cf-a69a-6d899e11d331 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.982353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1088/2181] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:51.986888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.997073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d1e94-c173-4bf5-94d6-e61dd4bcdf32 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:52.001731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:52.002595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.002882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.003164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] PATH_INFO: `/v3/projects/d3980b69873e479888bb47b28669487d/users/7d04ac69b16644609f45e8554302d4fc/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.017906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3980b69873e479888bb47b28669487d, user_id=7d04ac69b16644609f45e8554302d4fc, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:52.020637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:52.034771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1094/2182] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:51 2022] PUT /identity/v3/projects/d3980b69873e479888bb47b28669487d/users/7d04ac69b16644609f45e8554302d4fc/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:52.046196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.046483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.046759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.075928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] MFA Rules not processed for user `7d04ac69b16644609f45e8554302d4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:52.077707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.164329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1089/2183] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:52.198775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:52.200831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.257480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:52.275802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a11d68-b3c2-4f9d-bfe1-b2c50f29a692 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:52.279844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca62d8-002d-4a63-8322-7e9d03aec250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:52.280536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca62d8-002d-4a63-8322-7e9d03aec250 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.280825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca62d8-002d-4a63-8322-7e9d03aec250 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.281110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca62d8-002d-4a63-8322-7e9d03aec250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.290294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca62d8-002d-4a63-8322-7e9d03aec250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:52.291894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca62d8-002d-4a63-8322-7e9d03aec250 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:52.307819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1095/2184] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:52.322915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:52.393137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190678e0-6749-4a75-bbe3-096cb4ae7984 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:52.398003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:52.398860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.399139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.399452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] PATH_INFO: `/v3/users/7d04ac69b16644609f45e8554302d4fc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.400677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d04ac69b16644609f45e8554302d4fc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:52.402607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:52.428187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:52.454716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d04ac69b16644609f45e8554302d4fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.455370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d04ac69b16644609f45e8554302d4fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.469601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d04ac69b16644609f45e8554302d4fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.476747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d04ac69b16644609f45e8554302d4fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.484402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d04ac69b16644609f45e8554302d4fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.490437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1090/2185] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:52 2022] DELETE /identity/v3/users/7d04ac69b16644609f45e8554302d4fc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:52.494944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333126c-ea89-40b0-a520-5710712d684f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.495231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333126c-ea89-40b0-a520-5710712d684f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.495509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333126c-ea89-40b0-a520-5710712d684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.515041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f333126c-ea89-40b0-a520-5710712d684f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:52.516315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f333126c-ea89-40b0-a520-5710712d684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.575469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1096/2186] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:52.585816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:52.587258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.650535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6bb8-9545-4484-ac6a-024ed7f1956e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:52.655385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540d72-5f5a-4a61-bfcf-2bc4e6ac9264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:52.660118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540d72-5f5a-4a61-bfcf-2bc4e6ac9264 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.660118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540d72-5f5a-4a61-bfcf-2bc4e6ac9264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.660118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540d72-5f5a-4a61-bfcf-2bc4e6ac9264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.670805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540d72-5f5a-4a61-bfcf-2bc4e6ac9264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:52.672548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540d72-5f5a-4a61-bfcf-2bc4e6ac9264 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:52.683281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1091/2187] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:52.982645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333126c-ea89-40b0-a520-5710712d684f None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:52.984096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f333126c-ea89-40b0-a520-5710712d684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.996645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333126c-ea89-40b0-a520-5710712d684f None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.003318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.004269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.004577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.004776 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] PATH_INFO: `/v3/projects/d3980b69873e479888bb47b28669487d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.005979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3980b69873e479888bb47b28669487d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.007964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.075582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3980b69873e479888bb47b28669487d', 'request_id': 'req-1c0cf943-4ea1-4fba-a114-cf93b4c63534'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.084649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3980b69873e479888bb47b28669487d', 'request_id': 'req-1c0cf943-4ea1-4fba-a114-cf93b4c63534'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.096176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3980b69873e479888bb47b28669487d', 'request_id': 'req-1c0cf943-4ea1-4fba-a114-cf93b4c63534'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.108255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] The token cache is being invalidate because project d3980b69873e479888bb47b28669487d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:53.108553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.109264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1c0cf943-4ea1-4fba-a114-cf93b4c63534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.110834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1097/2188] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:52 2022] DELETE /identity/v3/projects/d3980b69873e479888bb47b28669487d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:53.115828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.116305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.116773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.143978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:53.145477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:53.216093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1092/2189] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:53.224911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.225204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.225482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.245963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:53.247309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:53.256266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1098/2190] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:53.260343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.270676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f21b-f9da-41b9-a987-0138dcddad4f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.277204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.277879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.278162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.278482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.279794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:53.280222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.282006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.294801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1093/2191] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:53.300683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.310953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055c22-fec4-4598-a63a-7a6a4b45351d None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.315652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.316347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.316626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.316900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.317586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.319477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.349413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1099/2192] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:53 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:53.351003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.362325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f820-455a-4359-83f5-a1adc6678fd2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.394217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:53.427974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.429346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.429664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.429948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.430676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.432644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.453301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1094/2193] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:53 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:53.457389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.473419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d2859-a1ca-45e1-82d4-0bd198a4caa1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.478225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.478888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.479169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.479445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.480210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.481800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.493070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1100/2194] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:53.497003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.507411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616fe3f-ec05-48bb-9e1e-ac4b336d983d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.512364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a5d8-6ae2-4cf9-84db-18780938c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.516813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a5d8-6ae2-4cf9-84db-18780938c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.516813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a5d8-6ae2-4cf9-84db-18780938c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.516813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a5d8-6ae2-4cf9-84db-18780938c5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.516813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227a5d8-6ae2-4cf9-84db-18780938c5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.517209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227a5d8-6ae2-4cf9-84db-18780938c5f0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.531603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1095/2195] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:53.535857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.546507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a30df-ec91-4087-9fae-ac9e5cd99499 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.551404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.552535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.552872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.553168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] PATH_INFO: `/v3/projects/a2bcca8d2bcb49a6bd3a34b79cd3b4c7/users/9389de131b934fa3af986898d112380f/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.572420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bcca8d2bcb49a6bd3a34b79cd3b4c7, user_id=9389de131b934fa3af986898d112380f, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.575188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.585337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:53.591092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1101/2196] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:53 2022] PUT /identity/v3/projects/a2bcca8d2bcb49a6bd3a34b79cd3b4c7/users/9389de131b934fa3af986898d112380f/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:53.603909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.604293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.604697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.632431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] MFA Rules not processed for user `9389de131b934fa3af986898d112380f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:53.633843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:53.720528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1096/2197] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:53.731327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.733059 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:53.794673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6095f-ebc9-490c-8759-54f1283fede0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.799223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9954f-e71d-4a0d-b24d-3b9f04ff097f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.799925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9954f-e71d-4a0d-b24d-3b9f04ff097f service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.800302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9954f-e71d-4a0d-b24d-3b9f04ff097f service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.800715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9954f-e71d-4a0d-b24d-3b9f04ff097f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.811472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9954f-e71d-4a0d-b24d-3b9f04ff097f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.813127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9954f-e71d-4a0d-b24d-3b9f04ff097f service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.823745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1102/2198] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:56.501081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:56.502543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:56.579454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2b151-5971-4c72-a559-002c7c6afe27 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:56.584713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:56.585692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:56.585975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:56.586258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] PATH_INFO: `/v3/users/a34648fc19bd43d0ad0db287fbbff59d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:56.587633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34648fc19bd43d0ad0db287fbbff59d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:56.589596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:56.640090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:56.647372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34648fc19bd43d0ad0db287fbbff59d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:56.648422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34648fc19bd43d0ad0db287fbbff59d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:56.661247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34648fc19bd43d0ad0db287fbbff59d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:56.668312 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34648fc19bd43d0ad0db287fbbff59d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:56.677122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34648fc19bd43d0ad0db287fbbff59d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:56.684519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1097/2199] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:56 2022] DELETE /identity/v3/users/a34648fc19bd43d0ad0db287fbbff59d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:56.690497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:56.690497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:56.691078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:56.710746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:56.712017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:56.781295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1103/2200] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:56.791016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:56.792553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:56.857705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354dd7d-1e74-4939-b5bd-d3123dcb674f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:56.861590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0198fd-83ce-4f4c-a142-c481c42a2589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:56.862251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0198fd-83ce-4f4c-a142-c481c42a2589 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:56.862539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0198fd-83ce-4f4c-a142-c481c42a2589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:56.862822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0198fd-83ce-4f4c-a142-c481c42a2589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:56.874889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0198fd-83ce-4f4c-a142-c481c42a2589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:56.876385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0198fd-83ce-4f4c-a142-c481c42a2589 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:56.886905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1098/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:57.050198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:57.051865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.064497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25ea1-be09-4af4-b47b-335b44379a65 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:57.069690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:57.070570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.070872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.071484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] PATH_INFO: `/v3/users/9389de131b934fa3af986898d112380f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.072696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9389de131b934fa3af986898d112380f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:57.074721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:57.129588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9389de131b934fa3af986898d112380f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.130355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9389de131b934fa3af986898d112380f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.142749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9389de131b934fa3af986898d112380f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.149857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9389de131b934fa3af986898d112380f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.157364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9389de131b934fa3af986898d112380f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.164478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1104/2202] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:57 2022] DELETE /identity/v3/users/9389de131b934fa3af986898d112380f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:57.169402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.170344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.170545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.184449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:57.186996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.189473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:57.190826 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.208795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:57.268449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e01413-8b9b-4f29-b20d-e91d93605c3f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:57.269383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1099/2203] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:57.273831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:57.274832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.275120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.275427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] PATH_INFO: `/v3/projects/d66d9460817f4c08aa2403eefb1d7b68` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.276899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66d9460817f4c08aa2403eefb1d7b68)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:57.279744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:57.279982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:57.281373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.329114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66d9460817f4c08aa2403eefb1d7b68', 'request_id': 'req-0d72038e-fb50-44e0-a7f6-2ff7288baf64'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.335841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66d9460817f4c08aa2403eefb1d7b68', 'request_id': 'req-0d72038e-fb50-44e0-a7f6-2ff7288baf64'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.338746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b398d-f59e-40ee-bac7-a338b420246c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:57.344870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66d9460817f4c08aa2403eefb1d7b68', 'request_id': 'req-0d72038e-fb50-44e0-a7f6-2ff7288baf64'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.352305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:57.357016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] The token cache is being invalidate because project d66d9460817f4c08aa2403eefb1d7b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:57.357331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.357991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.359906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1105/2204] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:57 2022] DELETE /identity/v3/projects/d66d9460817f4c08aa2403eefb1d7b68 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:57.363936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:57.365343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.392392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:57.393043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.393330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.393610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.395481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.433521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72038e-fb50-44e0-a7f6-2ff7288baf64 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:57.438386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:57.439262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.439546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.439827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] PATH_INFO: `/v3/users/2f569b766bf7443d812cea6e659bb307` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.441082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f569b766bf7443d812cea6e659bb307)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:57.443010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:57.460531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:57.461968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2300-0ef5-49d7-abec-a3922944c156 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:57.472790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1100/2205] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:57.491625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f569b766bf7443d812cea6e659bb307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.492388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f569b766bf7443d812cea6e659bb307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.493679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:57.507690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f569b766bf7443d812cea6e659bb307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.515198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f569b766bf7443d812cea6e659bb307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.522989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f569b766bf7443d812cea6e659bb307'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:57.530039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1106/2206] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:57 2022] DELETE /identity/v3/users/2f569b766bf7443d812cea6e659bb307 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:57.711639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.713440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.714296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.735412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:57.737286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.802768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1101/2207] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:57.819535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:57.821774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.867179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:57.868850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:57.959065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5eb0-baac-4b34-bc9a-91aa441e8a46 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:57.966913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:57.968269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:57.968639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:57.968986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] PATH_INFO: `/v3/projects/a2bcca8d2bcb49a6bd3a34b79cd3b4c7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:57.970363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bcca8d2bcb49a6bd3a34b79cd3b4c7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:57.973052 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:57.991957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfefa8-c390-4144-9e34-95d0fb7e6d56 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.000284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.001802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.002362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.002605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] PATH_INFO: `/v3/projects/27c666e368804bdfbca23dea78a6986d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.003908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c666e368804bdfbca23dea78a6986d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.005866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.023243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:58.045389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bcca8d2bcb49a6bd3a34b79cd3b4c7', 'request_id': 'req-9ed23c7e-2b6e-481d-be26-a51421217fff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.052287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bcca8d2bcb49a6bd3a34b79cd3b4c7', 'request_id': 'req-9ed23c7e-2b6e-481d-be26-a51421217fff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.059261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c666e368804bdfbca23dea78a6986d', 'request_id': 'req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.059646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bcca8d2bcb49a6bd3a34b79cd3b4c7', 'request_id': 'req-9ed23c7e-2b6e-481d-be26-a51421217fff'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.066392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c666e368804bdfbca23dea78a6986d', 'request_id': 'req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.072181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] The token cache is being invalidate because project a2bcca8d2bcb49a6bd3a34b79cd3b4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:58.072480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.073183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.074487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c666e368804bdfbca23dea78a6986d', 'request_id': 'req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.074801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1107/2208] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:57 2022] DELETE /identity/v3/projects/a2bcca8d2bcb49a6bd3a34b79cd3b4c7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:58.075809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.077397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.086473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] The token cache is being invalidate because project 27c666e368804bdfbca23dea78a6986d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:58.086765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.087424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-faa3c8b7-0214-478e-ae8f-95a0e6e66d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:58.089204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1102/2209] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:57 2022] DELETE /identity/v3/projects/27c666e368804bdfbca23dea78a6986d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:58.094084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2132e34-84f7-4622-be05-fbdceea09559 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.094370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2132e34-84f7-4622-be05-fbdceea09559 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.094651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2132e34-84f7-4622-be05-fbdceea09559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.113076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e2132e34-84f7-4622-be05-fbdceea09559 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:58.114268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2132e34-84f7-4622-be05-fbdceea09559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.132375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:58.151311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23c7e-2b6e-481d-be26-a51421217fff admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.183879 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1103/2210] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:58.185842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1c94-cfab-4e54-bcbc-4036588577cc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.186138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1c94-cfab-4e54-bcbc-4036588577cc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.186437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1c94-cfab-4e54-bcbc-4036588577cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.208141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-07ab1c94-cfab-4e54-bcbc-4036588577cc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:58.209298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-07ab1c94-cfab-4e54-bcbc-4036588577cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.223735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1104/2211] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:58.223735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83abd-e95d-4375-ba62-23ad17e718c7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.223735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83abd-e95d-4375-ba62-23ad17e718c7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.223735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83abd-e95d-4375-ba62-23ad17e718c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.240314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.241124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.241550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.241685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d7b83abd-e95d-4375-ba62-23ad17e718c7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:58.241861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.243022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7b83abd-e95d-4375-ba62-23ad17e718c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.244256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.251799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1105/2212] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:58.256053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.256359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.256966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.274548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:58.275729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.284430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1106/2213] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:58.285049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.295256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898eeff-9f08-4a2d-931d-fee496def802 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.300045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.300717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.301011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.301294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.302020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:58.302332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.303917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.309226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.311057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.316392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1107/2214] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:58.317189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.320240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1108/2215] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:54:58.320891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.330396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235891c-04fe-472c-ae56-729fd3912e6a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.331814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a063d5-5f0e-40a3-b10e-5fbcd0ab4341 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.336432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.336716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.337096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.337356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.337485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.338309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.338383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.338463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.338541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:58.338701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.338804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.340276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.340515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.353471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1108/2216] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:58.358507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.369935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bf7c0-05aa-4d67-9f01-4b5ad09244d4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.377809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.378840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.379350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.379953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.380900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.383425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.387609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1109/2217] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:58.393122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.428241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1109/2218] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:58.430056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.480181 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:58.483023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14c46f-3a74-4b33-a4be-594751c790a9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.512466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:58.521034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38f4d0-b44f-499b-a519-957c835aba44 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.531228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.532784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.532784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.533304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.534129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.536842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.577868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1110/2219] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:58.578651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.585852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.586826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.587386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.587769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.588564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.590669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78a3d0-a264-4175-8249-28a62ce39151 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.591107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.598656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.600010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.600396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.600880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.602709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.604916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.620485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1110/2220] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:58.620647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1111/2221] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:58.621886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.624869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.637260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32468f-9c0b-4b39-b4c6-305c002869e9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.637490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f7820-65a3-4930-903d-4bb361905407 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.645824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.646213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.646501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.646791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.646913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.647161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.647273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.647425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.648093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.648702 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.649835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.650286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.664154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1111/2222] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:58.664445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1112/2223] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:58.666580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.671332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.679139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18779e18-8bdd-4f36-bfdf-2c39c388a5d0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.685377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.686338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.686780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.687444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.688477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.689818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9561-9f85-452e-8aad-8623ec40db74 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.690907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.697067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d445bb-ee2a-4c01-8eaf-113ded2532dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.698209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d445bb-ee2a-4c01-8eaf-113ded2532dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.698769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d445bb-ee2a-4c01-8eaf-113ded2532dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.699128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d445bb-ee2a-4c01-8eaf-113ded2532dd admin admin] PATH_INFO: `/v3/projects/7fb0fedec0fd41a9b4ab020309c0955a/users/6821f1cdcb384d6f87d5706572bc13dd/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.720945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d445bb-ee2a-4c01-8eaf-113ded2532dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb0fedec0fd41a9b4ab020309c0955a, user_id=6821f1cdcb384d6f87d5706572bc13dd, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.724359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d445bb-ee2a-4c01-8eaf-113ded2532dd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.730541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1112/2224] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:58.731960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.753155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b1cb5-c275-4b5b-8ffc-ce22c4caf2f4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.753751 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1113/2225] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:58 2022] PUT /identity/v3/projects/7fb0fedec0fd41a9b4ab020309c0955a/users/6821f1cdcb384d6f87d5706572bc13dd/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:58.755726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.756225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.756651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.799246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] MFA Rules not processed for user `6821f1cdcb384d6f87d5706572bc13dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:58.800781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:58.836298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6431b-7cc5-4cc5-8a2a-ed0e6099b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:58.838199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6431b-7cc5-4cc5-8a2a-ed0e6099b5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.838815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6431b-7cc5-4cc5-8a2a-ed0e6099b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.839102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6431b-7cc5-4cc5-8a2a-ed0e6099b5e4 admin admin] PATH_INFO: `/v3/projects/e0c28e7e4ee04bbab5e420580c6cb4e4/users/da36d6d1e7f74f97a68db9a47713c38c/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.860865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6431b-7cc5-4cc5-8a2a-ed0e6099b5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c28e7e4ee04bbab5e420580c6cb4e4, user_id=da36d6d1e7f74f97a68db9a47713c38c, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:58.865377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6431b-7cc5-4cc5-8a2a-ed0e6099b5e4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:58.905400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1113/2226] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:58 2022] PUT /identity/v3/projects/e0c28e7e4ee04bbab5e420580c6cb4e4/users/da36d6d1e7f74f97a68db9a47713c38c/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:58.907043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1114/2227] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:58.909007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:58.909543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:58.909934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:58.913715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:58.926346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d51b-dec1-47bc-ad21-5b16ccfdc26d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:58.947024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] MFA Rules not processed for user `da36d6d1e7f74f97a68db9a47713c38c`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:58.948644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:59.002224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.003297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.004092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.004584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.005727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.009589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.038968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:59.064287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1115/2228] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:59.065740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:59.109917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1114/2229] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:59.122220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:59.125500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:59.137127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:59.177035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491b97a-afe9-434e-9f7d-9c4fe485afac admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:59.184160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.184878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.185383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.185791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.186859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.189427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.268725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1116/2230] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:59 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:59.269927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:59.298431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d4e5-53e7-4ad2-a64a-1467e8ac7b20 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:59.302055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f63fb-aa80-41a8-b98b-c1b115fd6a1a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:59.306636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.307460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.307821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.308128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.309111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.310996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.335050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1117/2231] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:59.339369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:59.379381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba752-8360-4d8d-a215-4ecb5e318d19 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:59.388967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.390152 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.390751 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.392325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.393038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] PATH_INFO: `/v3/projects/3cedca7e04b54dd0a91c813c296b067b/users/41082ff0f660479a93edd4e0e10fde7a/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.393160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.393424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.393769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.415896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cedca7e04b54dd0a91c813c296b067b, user_id=41082ff0f660479a93edd4e0e10fde7a, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.419890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.442151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1118/2232] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:59 2022] PUT /identity/v3/projects/3cedca7e04b54dd0a91c813c296b067b/users/41082ff0f660479a93edd4e0e10fde7a/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:59.446433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:59.499751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.501584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.512350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1115/2233] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:59.559866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c625d-dccb-4bdf-94ab-1969e5d00496 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:59.565998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db13ec-90f4-4a34-82cd-19ebc76344c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.566751 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db13ec-90f4-4a34-82cd-19ebc76344c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.567108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db13ec-90f4-4a34-82cd-19ebc76344c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.569965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db13ec-90f4-4a34-82cd-19ebc76344c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.571482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db13ec-90f4-4a34-82cd-19ebc76344c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.573029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db13ec-90f4-4a34-82cd-19ebc76344c2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.591213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1119/2234] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:59.605449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:59.618910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c1ac-4fbc-43d2-88ed-df81fb486195 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:59.630135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:59.631172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.632051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.632565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] PATH_INFO: `/v3/projects/3cedca7e04b54dd0a91c813c296b067b/users/41082ff0f660479a93edd4e0e10fde7a/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.637155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cedca7e04b54dd0a91c813c296b067b, user_id=41082ff0f660479a93edd4e0e10fde7a, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:59.641852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:59.667502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1116/2235] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:59 2022] PUT /identity/v3/projects/3cedca7e04b54dd0a91c813c296b067b/users/41082ff0f660479a93edd4e0e10fde7a/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:59.670747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:59.671148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:59.671525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:59.731315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] MFA Rules not processed for user `41082ff0f660479a93edd4e0e10fde7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:59.736214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:59.798005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:59.846180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1120/2236] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:00.016501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:00.106882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5f22-1d59-40b3-90a1-cd61fab6e994 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:00.111992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:00.112686 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:00.112973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:00.113254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:00.128038 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:00.198539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:00.200821 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:00.218427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1117/2237] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:04.854255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:04.883776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fb7a0-2409-495f-9c6d-adfd0629b486 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:04.890975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae38ce-0f6b-4c74-b46a-adb2f4dd9adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:04.891558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae38ce-0f6b-4c74-b46a-adb2f4dd9adb service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:04.891860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae38ce-0f6b-4c74-b46a-adb2f4dd9adb service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:04.892188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae38ce-0f6b-4c74-b46a-adb2f4dd9adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:04.917246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae38ce-0f6b-4c74-b46a-adb2f4dd9adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:04.922023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae38ce-0f6b-4c74-b46a-adb2f4dd9adb service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:04.937201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1121/2238] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:09.279842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:09.281742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:09.358666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05fb1b-6f96-4ad6-8542-3dbf3ee0632e service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:09.364105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:09.372663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:09.373008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:09.373299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] PATH_INFO: `/v3/users/1955c9117da04a328cc134e2cb4dfcfe` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:09.374769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1955c9117da04a328cc134e2cb4dfcfe)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:09.377417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:09.432973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1955c9117da04a328cc134e2cb4dfcfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:09.433793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1955c9117da04a328cc134e2cb4dfcfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:09.447662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1955c9117da04a328cc134e2cb4dfcfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:09.455300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1955c9117da04a328cc134e2cb4dfcfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:09.463414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1955c9117da04a328cc134e2cb4dfcfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:09.474376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1118/2239] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:09 2022] DELETE /identity/v3/users/1955c9117da04a328cc134e2cb4dfcfe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:09.476218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:09.476698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:09.476799 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:09.506091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:09.508746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:09.598565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:09.599953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:09.602490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1122/2240] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:09.657095 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:09.688829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f881-65c6-41e0-8058-4796a505671d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:09.695259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dbdad-5a82-4671-9482-613af2fc97e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:09.697074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dbdad-5a82-4671-9482-613af2fc97e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:09.697539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dbdad-5a82-4671-9482-613af2fc97e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:09.697779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dbdad-5a82-4671-9482-613af2fc97e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:09.713527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dbdad-5a82-4671-9482-613af2fc97e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:09.716859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dbdad-5a82-4671-9482-613af2fc97e6 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:09.738908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1119/2241] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:55:10.059012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.061680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.077858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d39b9-ff06-4928-8063-13c477bdd732 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.082766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.083734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.084082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.084554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] PATH_INFO: `/v3/projects/e7875545154740fca1737845d575e005` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.085970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7875545154740fca1737845d575e005)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.087971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.155015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7875545154740fca1737845d575e005', 'request_id': 'req-015ceb05-8307-43b1-8524-a576e732310c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.163383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7875545154740fca1737845d575e005', 'request_id': 'req-015ceb05-8307-43b1-8524-a576e732310c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.181519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7875545154740fca1737845d575e005', 'request_id': 'req-015ceb05-8307-43b1-8524-a576e732310c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.197520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] The token cache is being invalidate because project e7875545154740fca1737845d575e005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:10.198868 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.199877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.202873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1123/2242] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:10 2022] DELETE /identity/v3/projects/e7875545154740fca1737845d575e005 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:10.212337 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce392b-cf25-4066-b8d9-2a99408c37ea None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.212652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce392b-cf25-4066-b8d9-2a99408c37ea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.213606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce392b-cf25-4066-b8d9-2a99408c37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.245146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-61ce392b-cf25-4066-b8d9-2a99408c37ea None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:10.246398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-61ce392b-cf25-4066-b8d9-2a99408c37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.311635 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.324260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.378766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1120/2243] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:10.392989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.393332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.393569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.412507 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:10.416125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:10.417002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.431045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1121/2244] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:10.434158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.458589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480ad9b-ebd8-41af-921b-a4371f91c2a9 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.461732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ceb05-8307-43b1-8524-a576e732310c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.468037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.468697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.468967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.469254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.469535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] PATH_INFO: `/v3/users/6821f1cdcb384d6f87d5706572bc13dd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.469842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.470186 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.470526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.470742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6821f1cdcb384d6f87d5706572bc13dd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.471379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:10.471752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.472709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.473524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.496119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1122/2245] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:10.499374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.514812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8957-1fb0-49ec-81f8-503ae3f1105c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.524264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.525751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.526279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.526626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.527463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.531804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.568105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1123/2246] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:10 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:10.570649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.581174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6821f1cdcb384d6f87d5706572bc13dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.581849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6821f1cdcb384d6f87d5706572bc13dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.597122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6821f1cdcb384d6f87d5706572bc13dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.607328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6821f1cdcb384d6f87d5706572bc13dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.628389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-18748c57-e168-4220-b780-d3f22f9e2cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6821f1cdcb384d6f87d5706572bc13dd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.636291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1124/2247] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:10 2022] DELETE /identity/v3/users/6821f1cdcb384d6f87d5706572bc13dd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:10.641005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.641477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.641797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.657854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c0a1-fb16-4874-aac4-9d4a4b68466f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.662558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:10.663837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.726026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:10.750117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.751160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.751574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.752163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.753221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.756912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.757816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1125/2248] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:10.764214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.765652 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.790169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1124/2249] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:10 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:10.791080 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.792764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.810996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a33ac-fb11-4656-87ee-8544de7c0139 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.817931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.818964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.819268 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.819722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] PATH_INFO: `/v3/users/da36d6d1e7f74f97a68db9a47713c38c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.822343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da36d6d1e7f74f97a68db9a47713c38c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.824887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.844998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73293e-1f97-4865-8d18-830c2b1ff3dc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.850188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.850994 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.851288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.851564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.864110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.866193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.883389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1126/2250] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:10.884328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.885189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da36d6d1e7f74f97a68db9a47713c38c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.885743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.885855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da36d6d1e7f74f97a68db9a47713c38c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.894982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:10.900198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da36d6d1e7f74f97a68db9a47713c38c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.905225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe502cef-2999-47cb-8c26-81eabc0ae608 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.914503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da36d6d1e7f74f97a68db9a47713c38c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.918699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:10.919066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.919864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.921603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.923393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:10.925901 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:10.931817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-25ba9933-3e7e-4069-8c49-7245350d279f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da36d6d1e7f74f97a68db9a47713c38c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:10.946595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1125/2251] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:10 2022] DELETE /identity/v3/users/da36d6d1e7f74f97a68db9a47713c38c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:10.951840 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:10.951988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1127/2252] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:10.952122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:10.952122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:10.953121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:10.957275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:10.985295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd1b69-2e1e-41b7-8dc1-3b18af5d6560 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:10.988350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:10.989641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:11.098761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1126/2253] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:11.114143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:11.133141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:11.134655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.137066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.137355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.137632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.139292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.140951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.154504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1128/2254] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:11.159324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:11.178035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c360f4-65a9-442e-9840-dfbc3ceb97eb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:11.185297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9105922-b20a-40d1-b5b2-bb88ec64bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.186201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9105922-b20a-40d1-b5b2-bb88ec64bd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.186479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9105922-b20a-40d1-b5b2-bb88ec64bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.186890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9105922-b20a-40d1-b5b2-bb88ec64bd34 admin admin] PATH_INFO: `/v3/projects/3f26f1edbd9a4e25b6c7cdc4707119b5/users/12646e903d5942058533deb6098b522c/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.217280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9105922-b20a-40d1-b5b2-bb88ec64bd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f26f1edbd9a4e25b6c7cdc4707119b5, user_id=12646e903d5942058533deb6098b522c, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.220906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9105922-b20a-40d1-b5b2-bb88ec64bd34 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.229323 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:11.247103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcf6a-dede-42a0-872c-037ae749ac00 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:11.255073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1129/2255] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:11 2022] PUT /identity/v3/projects/3f26f1edbd9a4e25b6c7cdc4707119b5/users/12646e903d5942058533deb6098b522c/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:11.266887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.267176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.267456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.337957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] MFA Rules not processed for user `12646e903d5942058533deb6098b522c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:11.339407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:11.381874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.382552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.382839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.383150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.461331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1130/2256] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:11.462493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:11.465615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:11.496977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.498911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.514609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1127/2257] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:11.515920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:11.517512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:11.542774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:11.562900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad733-ee5e-471c-8735-7197af305e31 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:11.569668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.570818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.571547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.571941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] PATH_INFO: `/v3/projects/7fb0fedec0fd41a9b4ab020309c0955a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.581032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb0fedec0fd41a9b4ab020309c0955a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.584125 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.641923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff76bea-1eb0-4a30-864c-10b4e645c5ca service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:11.653006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.654231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.654519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.654801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.672522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.674147 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.679784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb0fedec0fd41a9b4ab020309c0955a', 'request_id': 'req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:11.688411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb0fedec0fd41a9b4ab020309c0955a', 'request_id': 'req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:11.700282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb0fedec0fd41a9b4ab020309c0955a', 'request_id': 'req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:11.702902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1128/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:11.717245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] The token cache is being invalidate because project 7fb0fedec0fd41a9b4ab020309c0955a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:11.717667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:11.718963 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:11.721019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1131/2259] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:11 2022] DELETE /identity/v3/projects/7fb0fedec0fd41a9b4ab020309c0955a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:11.727396 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:11.745289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf273f2-bd43-4ffa-96f5-18176a2c896b service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:11.855356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:11.884795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.885849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.886188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.886503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] PATH_INFO: `/v3/users/41082ff0f660479a93edd4e0e10fde7a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.888011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41082ff0f660479a93edd4e0e10fde7a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.890587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.910589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:11.912211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:11.938518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d30ef-9dce-4bd4-99af-d21d979bd2c9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:11.951174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:11.952334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:11.952631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:11.952858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] PATH_INFO: `/v3/projects/e0c28e7e4ee04bbab5e420580c6cb4e4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:11.954829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c28e7e4ee04bbab5e420580c6cb4e4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:11.959789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:11.988958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41082ff0f660479a93edd4e0e10fde7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:11.991780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41082ff0f660479a93edd4e0e10fde7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.020518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41082ff0f660479a93edd4e0e10fde7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.028954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41082ff0f660479a93edd4e0e10fde7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.030077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c28e7e4ee04bbab5e420580c6cb4e4', 'request_id': 'req-8b58a897-fc33-46d5-ab40-b7e14df1aa17'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.044339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c28e7e4ee04bbab5e420580c6cb4e4', 'request_id': 'req-8b58a897-fc33-46d5-ab40-b7e14df1aa17'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.047010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41082ff0f660479a93edd4e0e10fde7a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.056973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1129/2260] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:11 2022] DELETE /identity/v3/users/41082ff0f660479a93edd4e0e10fde7a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:12.066222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c28e7e4ee04bbab5e420580c6cb4e4', 'request_id': 'req-8b58a897-fc33-46d5-ab40-b7e14df1aa17'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.087270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] The token cache is being invalidate because project e0c28e7e4ee04bbab5e420580c6cb4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:12.087645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.088355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b58a897-fc33-46d5-ab40-b7e14df1aa17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.104242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1132/2261] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:11 2022] DELETE /identity/v3/projects/e0c28e7e4ee04bbab5e420580c6cb4e4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:12.506629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:12.508529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:12.647808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cac3b-1dc0-4042-8c13-272a48c9ad11 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:12.652981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:12.654942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:12.655523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:12.656000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] PATH_INFO: `/v3/projects/3cedca7e04b54dd0a91c813c296b067b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:12.657441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cedca7e04b54dd0a91c813c296b067b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:12.660365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:12.727792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cedca7e04b54dd0a91c813c296b067b', 'request_id': 'req-66298cab-6640-41b8-9746-64d3e9f0d109'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.738353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cedca7e04b54dd0a91c813c296b067b', 'request_id': 'req-66298cab-6640-41b8-9746-64d3e9f0d109'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.747554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cedca7e04b54dd0a91c813c296b067b', 'request_id': 'req-66298cab-6640-41b8-9746-64d3e9f0d109'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.759594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] The token cache is being invalidate because project 3cedca7e04b54dd0a91c813c296b067b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:12.759818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.764785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-66298cab-6640-41b8-9746-64d3e9f0d109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:12.769119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1130/2262] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:12 2022] DELETE /identity/v3/projects/3cedca7e04b54dd0a91c813c296b067b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:12.774729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:12.775527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:12.775995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:12.798463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:12.799852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:12.878677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1133/2263] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:12.881387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:12.881683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:12.881966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:12.891413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:12.907606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:12.909397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:12.924391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1131/2264] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:12.925740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:12.939853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863d762-3b58-4da6-a66e-272bb09175a2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:12.945366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:12.946502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:12.946788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:12.947077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:12.949962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:12.949962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:12.951943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:12.954270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:12.971718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1134/2265] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:12.974158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:12.985132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4290c-2a31-475d-a683-6f676b1b6cf8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:12.990452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:12.991631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:12.992308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:12.992755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:12.993664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:12.995660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.028234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1132/2266] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:12 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:13.031733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.043993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3dc7-0629-4b1d-a381-a7b0e3e1f31b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.129438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.130311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.130719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.131004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.131906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.133870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.162083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1135/2267] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:13 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:55:13.164592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.176014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0aa59-0053-453b-b849-421532905ba0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.182325 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.183110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.183458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.183805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.185451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.187267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.204433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1133/2268] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:13.208054 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.221257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da955ee-bc60-4df6-85ac-a7afa63ec9ca admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.226284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc820-67eb-4ab4-aacd-a81b46d7e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.227020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc820-67eb-4ab4-aacd-a81b46d7e9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.227373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc820-67eb-4ab4-aacd-a81b46d7e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.227722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc820-67eb-4ab4-aacd-a81b46d7e9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.228493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc820-67eb-4ab4-aacd-a81b46d7e9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.230090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc820-67eb-4ab4-aacd-a81b46d7e9ad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.249838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1136/2269] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:13.251009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.262033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df84b-593e-4657-8a65-7c897d9c111f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.267153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.268175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.268467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.268748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] PATH_INFO: `/v3/projects/5d5027b7a71144e9bf2e606ad12b7a6d/users/ab605be246ad4e2d83ae11b81899382c/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.289206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5027b7a71144e9bf2e606ad12b7a6d, user_id=ab605be246ad4e2d83ae11b81899382c, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.292026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.320539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1134/2270] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:13 2022] PUT /identity/v3/projects/5d5027b7a71144e9bf2e606ad12b7a6d/users/ab605be246ad4e2d83ae11b81899382c/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:13.328133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.328488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.328821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.361695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] MFA Rules not processed for user `ab605be246ad4e2d83ae11b81899382c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:13.364103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:13.479117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1137/2271] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:13.480511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.558003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75352-17af-49ab-bf3f-1fb411d279bb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.563685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.564404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.564692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.564968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.565671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.567702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.620719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1135/2272] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:13 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:13.624891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.637129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e71d0-bfba-4cbe-af4b-ad1413c80afb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.734737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.735658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.736107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.736598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.738290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.741206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.752664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:13.777244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1138/2273] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:13 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:55:13.781279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.797422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd5d9c-de59-46ae-9156-54196043344d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.812830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.814234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.815304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.815764 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.816778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.818530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.839364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1136/2274] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:13.842478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.856264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d0df-bbc0-4d8a-b06a-2663be5ddf7e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:13.881127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:13.882529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:13.883026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:13.883512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] PATH_INFO: `/v3/projects/24069aedc88f470cac942d6dcbf9f8a7/users/1407c272a17148259250065bd78113ba/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:13.923463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24069aedc88f470cac942d6dcbf9f8a7, user_id=1407c272a17148259250065bd78113ba, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:13.927781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:13.958186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1139/2275] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:13 2022] PUT /identity/v3/projects/24069aedc88f470cac942d6dcbf9f8a7/users/1407c272a17148259250065bd78113ba/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:13.962960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:13.979272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be62e-e7db-44e0-a0b3-4e447ea7739e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:14.101827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d981cf9-a5c2-4bd1-8df3-58516806b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:14.102608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d981cf9-a5c2-4bd1-8df3-58516806b5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:14.102993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d981cf9-a5c2-4bd1-8df3-58516806b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:14.103332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d981cf9-a5c2-4bd1-8df3-58516806b5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:14.104218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d981cf9-a5c2-4bd1-8df3-58516806b5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:14.106058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d981cf9-a5c2-4bd1-8df3-58516806b5c0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:14.119265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1137/2276] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:55:14.123694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:14.135124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3e20-8a11-4bdb-8255-b8c0a00bd6f5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:14.140811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:14.141916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:14.142200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:14.142684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] PATH_INFO: `/v3/projects/24069aedc88f470cac942d6dcbf9f8a7/users/1407c272a17148259250065bd78113ba/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:14.144990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24069aedc88f470cac942d6dcbf9f8a7, user_id=1407c272a17148259250065bd78113ba, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:14.148608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:14.174302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1140/2277] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:14 2022] PUT /identity/v3/projects/24069aedc88f470cac942d6dcbf9f8a7/users/1407c272a17148259250065bd78113ba/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:55:14.187104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:14.187407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:14.187672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:14.214521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:14.225627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] MFA Rules not processed for user `1407c272a17148259250065bd78113ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:14.227420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:14.316421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1138/2278] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:14.331779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:14.335793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:14.413844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f638331-dd7d-4293-aa3a-d38a9f32635f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:14.417835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1a260-9626-4653-94ea-fb27f37b2f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:14.418485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a260-9626-4653-94ea-fb27f37b2f3d service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:14.418773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a260-9626-4653-94ea-fb27f37b2f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:14.419559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1a260-9626-4653-94ea-fb27f37b2f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:14.487859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1a260-9626-4653-94ea-fb27f37b2f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:14.490011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1a260-9626-4653-94ea-fb27f37b2f3d service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:14.502448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1141/2279] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:17.151071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:17.249683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787516-69d5-47b1-8137-8e3e63d0e9ac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:17.254562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:17.255574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:17.256009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:17.257210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] PATH_INFO: `/v3/users/ab605be246ad4e2d83ae11b81899382c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:17.258127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab605be246ad4e2d83ae11b81899382c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:17.260516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:17.337288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab605be246ad4e2d83ae11b81899382c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:17.338355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab605be246ad4e2d83ae11b81899382c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:17.370487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab605be246ad4e2d83ae11b81899382c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:17.390221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab605be246ad4e2d83ae11b81899382c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:17.406746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab605be246ad4e2d83ae11b81899382c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:17.414479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1139/2280] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:17 2022] DELETE /identity/v3/users/ab605be246ad4e2d83ae11b81899382c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:17.418977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:17.419471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:17.419658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:17.449365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:17.451147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:17.546247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1142/2281] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:17.555684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:17.557122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:17.579387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:17.637177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e3ce1-61de-4ce6-872f-4995c6b6c2f4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:17.643920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:17.644802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:17.645084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:17.645359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:17.657103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:17.658963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:17.671386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1140/2282] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:18.177962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:18.179838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:18.196584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824aeeb-9eb1-4583-b024-10074c8fc200 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:18.203514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:18.205251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:18.205251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:18.205251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] PATH_INFO: `/v3/projects/5d5027b7a71144e9bf2e606ad12b7a6d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:18.206971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5027b7a71144e9bf2e606ad12b7a6d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:18.209300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:18.212663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:18.284693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5027b7a71144e9bf2e606ad12b7a6d', 'request_id': 'req-e1bdf11e-fa28-4286-9f19-58aed71f3a11'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.290698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5027b7a71144e9bf2e606ad12b7a6d', 'request_id': 'req-e1bdf11e-fa28-4286-9f19-58aed71f3a11'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.305045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5027b7a71144e9bf2e606ad12b7a6d', 'request_id': 'req-e1bdf11e-fa28-4286-9f19-58aed71f3a11'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.318159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] The token cache is being invalidate because project 5d5027b7a71144e9bf2e606ad12b7a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:18.318446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.319190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.325041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1143/2283] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:18 2022] DELETE /identity/v3/projects/5d5027b7a71144e9bf2e606ad12b7a6d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:18.326949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:18.338766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c459d-024c-4c4d-b5a6-a16f6b166c4c service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:18.413123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:18.414317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:18.414620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:18.415033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] PATH_INFO: `/v3/users/1407c272a17148259250065bd78113ba` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:18.417011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1407c272a17148259250065bd78113ba)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:18.420379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:18.488102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1407c272a17148259250065bd78113ba'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.488693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1407c272a17148259250065bd78113ba'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.505943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1407c272a17148259250065bd78113ba'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.514402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1407c272a17148259250065bd78113ba'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.524508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-56971525-fdb3-4cbf-8bf1-28ba3112b6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1407c272a17148259250065bd78113ba'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:18.532596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1141/2284] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:18 2022] DELETE /identity/v3/users/1407c272a17148259250065bd78113ba => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:18.846409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:18.848721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:18.866004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf11e-fa28-4286-9f19-58aed71f3a11 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:18.937946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:18.938838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:18.939119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:18.939392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] PATH_INFO: `/v3/projects/24069aedc88f470cac942d6dcbf9f8a7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:18.940695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24069aedc88f470cac942d6dcbf9f8a7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:18.942561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:18.996430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24069aedc88f470cac942d6dcbf9f8a7', 'request_id': 'req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:19.003446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24069aedc88f470cac942d6dcbf9f8a7', 'request_id': 'req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:19.012210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24069aedc88f470cac942d6dcbf9f8a7', 'request_id': 'req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:19.025452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] The token cache is being invalidate because project 24069aedc88f470cac942d6dcbf9f8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:19.025740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:19.026371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-499f4f87-f8cf-4dee-82ca-c55d7f7c7927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:19.028045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1144/2285] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:18 2022] DELETE /identity/v3/projects/24069aedc88f470cac942d6dcbf9f8a7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:19.035449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.035742 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.036020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.055710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:19.056985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:19.092960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:19.125487 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1142/2286] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:19.133688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.133977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.134258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.161186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:19.162489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:19.178015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1145/2287] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:19.179673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.191819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66443492-e0c5-4c90-a630-68b37174da5e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.197474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.198149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.198483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.199503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.199619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:19.199873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.202627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.216431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1143/2288] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:55:19.219689 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.231186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cad394-7ed2-46d6-b86a-a063e0fa7638 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.237231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.238095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.238492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.238838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.239756 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.246083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.264996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:19.292589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1146/2289] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:19 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:19.297104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.317414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc258b-e7f0-4cc5-a40b-a525417e4b4d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.384861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1797a-31b8-471c-9074-9a851a30dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.385542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1797a-31b8-471c-9074-9a851a30dcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.385830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1797a-31b8-471c-9074-9a851a30dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.386377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1797a-31b8-471c-9074-9a851a30dcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.387155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1797a-31b8-471c-9074-9a851a30dcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.390381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1797a-31b8-471c-9074-9a851a30dcf7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.414321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1144/2290] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:19 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:55:19.415559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.420218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.420512 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.420793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.426492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab368122-75f4-485d-9148-047f27bfcd94 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.432597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.433350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.433724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.434071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.435417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.437432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.441576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:19.442816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:19.481767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1147/2291] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:19.484985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.513789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39087427-f53f-4a33-bc69-bfd906e4460c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.521695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.522467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.522754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.523033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.523828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.525503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.527221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1145/2292] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 14 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:19.539021 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1148/2293] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:19.542584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.543081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.545046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:19.556315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f8e2-754d-43fa-89f6-b670cbe91be7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.563433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e466aa6-e695-4534-a98a-1801b7e11c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.564355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466aa6-e695-4534-a98a-1801b7e11c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.564643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466aa6-e695-4534-a98a-1801b7e11c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.564919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e466aa6-e695-4534-a98a-1801b7e11c8c admin admin] PATH_INFO: `/v3/projects/841fe20fcef14f37a50757b434ed7074/users/3c92a7c6cabf482b93672f9723f73455/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.581803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e466aa6-e695-4534-a98a-1801b7e11c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=841fe20fcef14f37a50757b434ed7074, user_id=3c92a7c6cabf482b93672f9723f73455, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.584459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e466aa6-e695-4534-a98a-1801b7e11c8c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.599664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1149/2294] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:19 2022] PUT /identity/v3/projects/841fe20fcef14f37a50757b434ed7074/users/3c92a7c6cabf482b93672f9723f73455/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:55:19.604992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.605596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.605867 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.624249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:19.624876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:19.626143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:19.632975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ef79-9e15-4644-bd47-8484d08d8f44 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.700876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.701573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.701898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.702137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.702967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1150/2295] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:19.716220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:19.717995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:19.767963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.769526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.780479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1146/2296] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:55:19.798840 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa427f2-cd26-454c-abb3-6c5bb62db4a0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:19.803860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:19.804718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:19.805065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:19.805353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:19.816553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:19.817983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:19.828730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1151/2297] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:55:21.943260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:21.944762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:21.960357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147592-c728-4df5-be5f-7c8edce0fd87 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:21.966420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:21.967350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:21.967637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:21.967934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] PATH_INFO: `/v3/users/12867bdde0f64629a0d6cc87b6c319fd` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:21.969184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12867bdde0f64629a0d6cc87b6c319fd)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:21.971853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:22.032848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12867bdde0f64629a0d6cc87b6c319fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.033759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12867bdde0f64629a0d6cc87b6c319fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.064277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12867bdde0f64629a0d6cc87b6c319fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.067744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12867bdde0f64629a0d6cc87b6c319fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.079078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f991f5e-73ae-4bd1-9f3e-123ab44fdb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12867bdde0f64629a0d6cc87b6c319fd'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.092054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1147/2298] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:21 2022] DELETE /identity/v3/users/12867bdde0f64629a0d6cc87b6c319fd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:22.661437 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:22.676036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6e33-7d74-4616-936b-38e560f74227 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:22.749948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:22.766435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:22.769632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:22.771378 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:22.771957 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] PATH_INFO: `/v3/projects/5c3edebbf5cf42e79e5dd23fd60edf8b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:22.775115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3edebbf5cf42e79e5dd23fd60edf8b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:22.781246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:22.863884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3edebbf5cf42e79e5dd23fd60edf8b', 'request_id': 'req-2ec8cae2-ffd3-4626-8a48-346f126129fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.877565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3edebbf5cf42e79e5dd23fd60edf8b', 'request_id': 'req-2ec8cae2-ffd3-4626-8a48-346f126129fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.889160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3edebbf5cf42e79e5dd23fd60edf8b', 'request_id': 'req-2ec8cae2-ffd3-4626-8a48-346f126129fc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.907858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] The token cache is being invalidate because project 5c3edebbf5cf42e79e5dd23fd60edf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:22.908191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.908925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ec8cae2-ffd3-4626-8a48-346f126129fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:22.911208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1152/2299] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:22 2022] DELETE /identity/v3/projects/5c3edebbf5cf42e79e5dd23fd60edf8b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:22.916956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:22.918111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:22.918628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:22.946704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:22.948298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:22.962511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:23.035802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1148/2300] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:23.043166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.043453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.043790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.092589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:23.094899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:23.138105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1153/2301] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:23.143359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.161413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657ae31-1d33-4ac8-83b1-4ed878349eb4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:23.178709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:23.179413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.180267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.180554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.181310 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:23.181621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:23.185826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:23.228674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.236040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1149/2302] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:23.241721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e9ec4-a6ce-4da7-9a67-f2b14880b150 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:23.252342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:23.252967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.253252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.253527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.254241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:23.256170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:23.330517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.345673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1154/2303] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:23 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:55:23.348822 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb8250-c203-41d8-90f5-8bd8b27c7b3e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:23.490257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:23.492254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.492572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.493027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.494720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:23.498576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:23.542632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.545185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1150/2304] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:23 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:23.557092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdce71-5536-4c8f-b653-1e36c1a91e9b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:23.564455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:23.565535 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.566088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.566543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.568460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:23.573050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:23.603241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1155/2305] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:23.605430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.623293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcae99-c72a-4da0-ad0d-2bb42db64a3e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:23.632797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b801-aa15-4833-91e0-a32279278d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:23.633518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b801-aa15-4833-91e0-a32279278d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.633836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b801-aa15-4833-91e0-a32279278d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.634149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b801-aa15-4833-91e0-a32279278d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.638483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b801-aa15-4833-91e0-a32279278d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:23.640917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b801-aa15-4833-91e0-a32279278d5f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:23.661370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1151/2306] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:23.664403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.681383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33a368-f117-47ca-bed8-b63f299aed38 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:23.689658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6c234-17f3-4eac-8ded-20ce4d22d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:23.690843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6c234-17f3-4eac-8ded-20ce4d22d89f admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.691837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6c234-17f3-4eac-8ded-20ce4d22d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.692376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6c234-17f3-4eac-8ded-20ce4d22d89f admin admin] PATH_INFO: `/v3/projects/6274d425b646414fbe1ab56b1d0f9791/users/f335eb3aa9314ac1800da93f086372bc/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.714418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6c234-17f3-4eac-8ded-20ce4d22d89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6274d425b646414fbe1ab56b1d0f9791, user_id=f335eb3aa9314ac1800da93f086372bc, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:23.719124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6c234-17f3-4eac-8ded-20ce4d22d89f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:23.746394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1156/2307] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:23 2022] PUT /identity/v3/projects/6274d425b646414fbe1ab56b1d0f9791/users/f335eb3aa9314ac1800da93f086372bc/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:23.749102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.749420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.749704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.787743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] MFA Rules not processed for user `f335eb3aa9314ac1800da93f086372bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:23.804422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:23.901529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b071-8b4a-49cd-8a67-cccf40f70148 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:23.901855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b071-8b4a-49cd-8a67-cccf40f70148 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:23.902085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9b071-8b4a-49cd-8a67-cccf40f70148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:23.932313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-24a9b071-8b4a-49cd-8a67-cccf40f70148 None None] MFA Rules not processed for user `f9c66bf9125f45818c304b3f595f6211`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:23.933579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24a9b071-8b4a-49cd-8a67-cccf40f70148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:23.949004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1152/2308] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:23.962098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:23.963863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:23.984619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:24.023559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1157/2309] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:24.086125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9cb7-dc1b-4801-83a2-f7e9012472dd None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:24.091426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:24.092204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:24.092562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:24.092988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:24.103345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:24.105041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:24.116428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1153/2310] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:26.431184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:26.431568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:26.431920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:26.461624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] MFA Rules not processed for user `3c92a7c6cabf482b93672f9723f73455`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:26.462936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:26.477194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:26.538042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1158/2311] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:26.542450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:26.544671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:26.618575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b5c0b-1840-48b9-8a4d-156920ee2346 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:26.623881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:26.624661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:26.625012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:26.625357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:26.626128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:26.628151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:26.654893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1154/2312] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:26 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:26.659012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:26.677107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cae78c-8160-4d8e-ba3e-e6eebc496193 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:26.745096 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:26.745776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:26.746055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:26.746336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:26.747558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:26.749572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:26.777032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1159/2313] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:26 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:26.778808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:26.790851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1835656-4f6b-43f4-a1eb-eb555c96fafe admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:26.795656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:26.796513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:26.796800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:26.797135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:26.797877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:26.799655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:26.812727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1155/2314] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:26.817092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:26.835975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138a10e-6cd1-489a-a9ba-a266cbe246b7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:26.840816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:26.841694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:26.841974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:26.842301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] PATH_INFO: `/v3/projects/bbadb66308274896b34651cc5346b93f/users/6e2b6d0abfc14899a2358901732bbdf7/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:26.863295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbadb66308274896b34651cc5346b93f, user_id=6e2b6d0abfc14899a2358901732bbdf7, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:26.868239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:26.890433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1160/2315] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:26 2022] PUT /identity/v3/projects/bbadb66308274896b34651cc5346b93f/users/6e2b6d0abfc14899a2358901732bbdf7/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:55:26.894632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:26.906730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c524af-3c7e-41be-9d65-4ec2e16bae70 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:27.000688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:27.001438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.001779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.002118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.002915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:27.005212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:27.006643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:27.019641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1156/2316] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:27.024504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:27.033732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8bef0-d338-45fe-b598-e5c9f90f4fec admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:27.036727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53d462-30c5-438d-825d-2fc8f0d9383d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:27.042024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:27.042937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.043250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.043640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] PATH_INFO: `/v3/users/f335eb3aa9314ac1800da93f086372bc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.046117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f335eb3aa9314ac1800da93f086372bc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:27.047670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ecb2-aa89-4af6-8d13-ad0562c66354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:27.048714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecb2-aa89-4af6-8d13-ad0562c66354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.048934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:27.049670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecb2-aa89-4af6-8d13-ad0562c66354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.050179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ecb2-aa89-4af6-8d13-ad0562c66354 admin admin] PATH_INFO: `/v3/projects/bbadb66308274896b34651cc5346b93f/users/6e2b6d0abfc14899a2358901732bbdf7/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.053171 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340ecb2-aa89-4af6-8d13-ad0562c66354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbadb66308274896b34651cc5346b93f, user_id=6e2b6d0abfc14899a2358901732bbdf7, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:27.066758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340ecb2-aa89-4af6-8d13-ad0562c66354 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:27.097121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1157/2317] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:27 2022] PUT /identity/v3/projects/bbadb66308274896b34651cc5346b93f/users/6e2b6d0abfc14899a2358901732bbdf7/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:27.151447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f335eb3aa9314ac1800da93f086372bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:27.152325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f335eb3aa9314ac1800da93f086372bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:27.176985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f335eb3aa9314ac1800da93f086372bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:27.183393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:27.188056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f335eb3aa9314ac1800da93f086372bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:27.220736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f335eb3aa9314ac1800da93f086372bc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:27.234599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1161/2318] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:27 2022] DELETE /identity/v3/users/f335eb3aa9314ac1800da93f086372bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:27.238847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.239134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.239592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.272423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:27.275751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:27.283425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:27.390510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1158/2319] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:27.408690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:27.410418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:27.542725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24953-029e-420a-a90d-8d7c0270a337 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:27.549539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b2fdd-1dc0-4a99-9755-d9a6d648584b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:27.552364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b2fdd-1dc0-4a99-9755-d9a6d648584b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.552364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b2fdd-1dc0-4a99-9755-d9a6d648584b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.552364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b2fdd-1dc0-4a99-9755-d9a6d648584b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.566778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b2fdd-1dc0-4a99-9755-d9a6d648584b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:27.566778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b2fdd-1dc0-4a99-9755-d9a6d648584b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:27.579508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1162/2320] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:28.346580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:28.348627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:28.374479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd6225-1c42-4307-abee-9deea4930b56 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:28.387218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:28.388397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:28.388662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:28.388941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] PATH_INFO: `/v3/projects/6274d425b646414fbe1ab56b1d0f9791` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:28.390223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6274d425b646414fbe1ab56b1d0f9791)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:28.392208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:28.506816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6274d425b646414fbe1ab56b1d0f9791', 'request_id': 'req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:28.519941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6274d425b646414fbe1ab56b1d0f9791', 'request_id': 'req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:28.538036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6274d425b646414fbe1ab56b1d0f9791', 'request_id': 'req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:28.558758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] The token cache is being invalidate because project 6274d425b646414fbe1ab56b1d0f9791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:28.559374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:28.561138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3b74be4b-5787-4d59-b2d9-4fb5d365ef06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:28.580406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1159/2321] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:28 2022] DELETE /identity/v3/projects/6274d425b646414fbe1ab56b1d0f9791 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:28.585441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:28.586373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:28.586902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:28.645512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:28.651570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:28.814460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1163/2322] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:28.827288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:28.828399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:28.829158 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:28.912623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:28.914040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:28.940889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1160/2323] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:28.944819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:28.959644 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c4ba-643a-449d-8218-20e76e28596b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:28.970168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:28.971244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:28.971857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:28.973323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:28.974543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:28.975348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:28.979240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:29.003881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1164/2324] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:29.005306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:29.026417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d174dec-0333-48ca-802a-ee3a4757de4e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:29.041608 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:29.042425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:29.042775 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:29.043146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:29.045210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:29.050389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:29.165018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1161/2325] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:29 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:29.167162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:29.184352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff4a7f-b26d-47ae-bc64-d5175d0ae17b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:29.312586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:29.313430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:29.314138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:29.314138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:29.314701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:29.317817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:29.366962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1165/2326] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:29 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:29.371053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:29.383029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766af6a-8cb2-48fe-8770-e5029d35a6cc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:29.396090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:29.396783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:29.397079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:29.397364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:29.398109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:29.407493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:29.445479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1162/2327] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:29.451124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:29.468705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587ff7a-eaf5-4b7e-add9-cd12da9944bd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:29.485287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9ed2-372a-4817-8317-36ac5beef0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:29.485997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9ed2-372a-4817-8317-36ac5beef0aa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:29.486262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9ed2-372a-4817-8317-36ac5beef0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:29.486542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9ed2-372a-4817-8317-36ac5beef0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:29.487282 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9ed2-372a-4817-8317-36ac5beef0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:29.489518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9ed2-372a-4817-8317-36ac5beef0aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:29.502251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:29.515570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1166/2328] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:29.518878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:29.535130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d4703-5839-4d95-984c-072f0a8103b2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:29.549311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:29.551045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:29.551429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:29.552180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] PATH_INFO: `/v3/projects/022896268f354d618b564bf9d558f201/users/ec0e407ebade49b7bb8329aa34a87c8d/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:29.604966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=022896268f354d618b564bf9d558f201, user_id=ec0e407ebade49b7bb8329aa34a87c8d, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:29.608224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:29.635381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1163/2329] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:29 2022] PUT /identity/v3/projects/022896268f354d618b564bf9d558f201/users/ec0e407ebade49b7bb8329aa34a87c8d/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:29.648128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b897-e54d-43b8-abd6-25b8236f1d4a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:29.648554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b897-e54d-43b8-abd6-25b8236f1d4a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:29.648693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b897-e54d-43b8-abd6-25b8236f1d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:29.693291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4411b897-e54d-43b8-abd6-25b8236f1d4a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:29.694552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4411b897-e54d-43b8-abd6-25b8236f1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:29.831754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1167/2330] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:29.852042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:29.854483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:29.981769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:30.043163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb03e0d-91fa-45be-b476-55cf5a87b26c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:30.056365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:30.057667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:30.058029 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:30.058446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:30.075457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:30.077928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:30.093726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1164/2331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:31.934581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad8675-bbe4-48b4-9181-fd82563d814a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:31.935099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad8675-bbe4-48b4-9181-fd82563d814a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:31.935195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad8675-bbe4-48b4-9181-fd82563d814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:31.966908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-24ad8675-bbe4-48b4-9181-fd82563d814a None None] MFA Rules not processed for user `ec0e407ebade49b7bb8329aa34a87c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:31.968186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24ad8675-bbe4-48b4-9181-fd82563d814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:32.065332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1168/2332] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:32.079556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:32.082977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:32.227061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3e6ac-f08c-4f93-ba63-3d486c69c6b7 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:32.236648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5714380-5f5a-4e47-ac6e-18aaaaced766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:32.237317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5714380-5f5a-4e47-ac6e-18aaaaced766 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:32.237605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5714380-5f5a-4e47-ac6e-18aaaaced766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:32.237886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5714380-5f5a-4e47-ac6e-18aaaaced766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:32.266468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5714380-5f5a-4e47-ac6e-18aaaaced766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:32.267951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5714380-5f5a-4e47-ac6e-18aaaaced766 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:32.315848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1165/2333] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:33.828275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:33.829179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:33.829465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:33.849150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] MFA Rules not processed for user `ec0e407ebade49b7bb8329aa34a87c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:33.850581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:33.858530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1169/2334] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:34.883695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83455a-06d4-467a-aeea-86d17a62f911 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:34.884330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83455a-06d4-467a-aeea-86d17a62f911 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:34.884330 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83455a-06d4-467a-aeea-86d17a62f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:34.929550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4b83455a-06d4-467a-aeea-86d17a62f911 None None] MFA Rules not processed for user `6e2b6d0abfc14899a2358901732bbdf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:34.930982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4b83455a-06d4-467a-aeea-86d17a62f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:35.027938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1166/2335] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:35.040916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:35.042866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:35.164936 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624d818-4f2a-4e9f-9d65-4a3ca5017842 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:35.172815 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:35.173486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:35.173771 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:35.174051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:35.178224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:35.234300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:35.263480 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:35.265186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:35.278551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1170/2336] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:35.403534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c14a-3f47-4bd5-ab8f-31ba6584de8d None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:35.403834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c14a-3f47-4bd5-ab8f-31ba6584de8d None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:35.404213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c14a-3f47-4bd5-ab8f-31ba6584de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:35.432131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9407c14a-3f47-4bd5-ab8f-31ba6584de8d None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:35.432131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9407c14a-3f47-4bd5-ab8f-31ba6584de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:35.501210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1167/2337] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:35.514027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:35.515429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:35.606738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89619058-b07c-4634-a2ed-965076db1d4d service glance] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:35.612346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:35.613072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:35.613357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:35.613639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:35.623466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:35.625158 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:35.634383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1171/2338] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:55:41.433797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:41.434912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:41.435306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:41.461733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:41.474180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:41.479314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:41.499403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1168/2339] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:41.515266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:41.531322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421468-642c-4c7c-b399-cc0d6a77968b service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:41.541884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a80a1-a47d-4fab-b569-5a22eaba1bdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:41.542561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a80a1-a47d-4fab-b569-5a22eaba1bdf service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:41.542854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a80a1-a47d-4fab-b569-5a22eaba1bdf service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:41.546110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a80a1-a47d-4fab-b569-5a22eaba1bdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:41.574070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a80a1-a47d-4fab-b569-5a22eaba1bdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:41.576164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a80a1-a47d-4fab-b569-5a22eaba1bdf service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:41.603726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1172/2340] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:55:46.330881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:46.332349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:46.375530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159df4e-cad6-4aa3-8666-390f4fb676ea None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:46.395458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:46.396301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:46.396582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:46.396858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] PATH_INFO: `/v3/users/12646e903d5942058533deb6098b522c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:46.404032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12646e903d5942058533deb6098b522c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:46.406637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:46.550944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12646e903d5942058533deb6098b522c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:46.552554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12646e903d5942058533deb6098b522c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:46.580506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12646e903d5942058533deb6098b522c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:46.596931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12646e903d5942058533deb6098b522c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:46.614877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0eca9ff0-ec3d-4950-93f2-90c7234a6ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12646e903d5942058533deb6098b522c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:46.625198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1169/2341] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:46 2022] DELETE /identity/v3/users/12646e903d5942058533deb6098b522c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:46.629858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:46.630768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:46.631198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:46.680564 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:46.682311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:46.719903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:46.720362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:46.720747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:46.750656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] MFA Rules not processed for user `5147d665ec624416a87056fb249f06b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:46.751721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:46.802374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1173/2342] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:46.815129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:46.816914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:46.893241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1170/2343] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:46.967639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4a882-a76f-4fc8-b567-80b9557404a3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:46.988758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2280c6-eab7-42ef-a210-d3a55d1570e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:46.990678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2280c6-eab7-42ef-a210-d3a55d1570e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:46.992402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2280c6-eab7-42ef-a210-d3a55d1570e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:46.992766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2280c6-eab7-42ef-a210-d3a55d1570e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:47.012691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:47.021077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2280c6-eab7-42ef-a210-d3a55d1570e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:47.022972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2280c6-eab7-42ef-a210-d3a55d1570e4 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:47.052170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1174/2344] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:55:47.601379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:47.603414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:47.637401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a6728-9242-4b54-8a3b-408796437b76 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:47.650757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:47.654472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:47.658279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:47.658572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] PATH_INFO: `/v3/projects/3f26f1edbd9a4e25b6c7cdc4707119b5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:47.661871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f26f1edbd9a4e25b6c7cdc4707119b5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:47.666831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:47.786683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f26f1edbd9a4e25b6c7cdc4707119b5', 'request_id': 'req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:47.810412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f26f1edbd9a4e25b6c7cdc4707119b5', 'request_id': 'req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:47.831661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f26f1edbd9a4e25b6c7cdc4707119b5', 'request_id': 'req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:47.851188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:47.874986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] The token cache is being invalidate because project 3f26f1edbd9a4e25b6c7cdc4707119b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:47.875317 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:47.880692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2036f4cc-a4a7-4196-81ff-4f1df3965d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:47.882521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1171/2345] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:47 2022] DELETE /identity/v3/projects/3f26f1edbd9a4e25b6c7cdc4707119b5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:47.888098 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:47.889072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:47.889582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:47.927256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:47.928898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:48.039439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1175/2346] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:48.047339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.047638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.047890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.092772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:48.094168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:48.117380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1172/2347] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:48.120576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.137765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3af979-67d4-40ec-9989-e388f22a7ba6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:48.142578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:48.143257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.143539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.143819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.144593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:48.144907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:48.146642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:48.161736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1176/2348] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:48.167018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.189016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4561fda-dfff-4521-9004-6da0ac8d1289 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:48.203523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:48.204643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.205160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.205673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.206684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:48.220779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:48.279434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1173/2349] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:48 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:48.283827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.298150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e83a2-8df0-48cb-a192-b4744a443c83 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:48.414196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:48.414880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.415167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.415444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.416247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:48.418834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:48.445529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1177/2350] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:48 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:48.448955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.465687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64dc42-ea3a-4c28-adfc-f280bea91717 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:48.475754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:48.477686 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.478706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.479060 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.480035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:48.482163 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:48.504425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1174/2351] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:48.505651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.519736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252c4cb-2ef8-4484-bffa-9d57d63c5c6c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:48.528646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659426c4-1f69-4bf2-a9ee-f9fb8ebc0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:48.529674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659426c4-1f69-4bf2-a9ee-f9fb8ebc0570 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.530160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659426c4-1f69-4bf2-a9ee-f9fb8ebc0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.530796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659426c4-1f69-4bf2-a9ee-f9fb8ebc0570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.531875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659426c4-1f69-4bf2-a9ee-f9fb8ebc0570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:48.533872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659426c4-1f69-4bf2-a9ee-f9fb8ebc0570 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:48.547416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1178/2352] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:55:48.551573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.567871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801b04-1871-4c62-a6bf-d03439dd8f13 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:48.580376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:48.581319 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.581606 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.581887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] PATH_INFO: `/v3/projects/cc055b321c894f748d4cb0200007f8c7/users/ac64c1cf66d54b4aabf188bd18fe6a1e/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.620958 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc055b321c894f748d4cb0200007f8c7, user_id=ac64c1cf66d54b4aabf188bd18fe6a1e, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:48.623847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:48.655885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1175/2353] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:48 2022] PUT /identity/v3/projects/cc055b321c894f748d4cb0200007f8c7/users/ac64c1cf66d54b4aabf188bd18fe6a1e/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:48.665063 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8f6a0-af8a-45e7-ad64-9df7d6a21e1c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:48.665512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8f6a0-af8a-45e7-ad64-9df7d6a21e1c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:48.666107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8f6a0-af8a-45e7-ad64-9df7d6a21e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:48.737065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-37d8f6a0-af8a-45e7-ad64-9df7d6a21e1c None None] MFA Rules not processed for user `ac64c1cf66d54b4aabf188bd18fe6a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:48.738617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-37d8f6a0-af8a-45e7-ad64-9df7d6a21e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:48.827131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:48.884724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1179/2354] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:48.896617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:48.900636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:48.997411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5587-0882-4c03-b4cd-0f12e50575f9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:49.001569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8e6e1-0803-499f-a1d6-51d98e19075e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:49.002837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e6e1-0803-499f-a1d6-51d98e19075e service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:49.003192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e6e1-0803-499f-a1d6-51d98e19075e service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:49.003884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e6e1-0803-499f-a1d6-51d98e19075e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:49.017872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8e6e1-0803-499f-a1d6-51d98e19075e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:49.019574 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8e6e1-0803-499f-a1d6-51d98e19075e service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:49.037741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1176/2355] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:50.653665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964720b0-8343-4700-ad4d-f12bab3f3131 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:50.654283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964720b0-8343-4700-ad4d-f12bab3f3131 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:50.654283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964720b0-8343-4700-ad4d-f12bab3f3131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:50.674391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-964720b0-8343-4700-ad4d-f12bab3f3131 None None] MFA Rules not processed for user `ac64c1cf66d54b4aabf188bd18fe6a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:50.675614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-964720b0-8343-4700-ad4d-f12bab3f3131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:50.695134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1180/2356] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:52.114811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:52.115333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:52.115428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:52.152488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] MFA Rules not processed for user `3c92a7c6cabf482b93672f9723f73455`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:52.153890 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:52.356418 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1177/2357] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:55:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:56.126235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410717e-284c-4dce-b655-c4011180911c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:56.127168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410717e-284c-4dce-b655-c4011180911c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:56.127721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410717e-284c-4dce-b655-c4011180911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:56.149525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a410717e-284c-4dce-b655-c4011180911c None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:56.151170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a410717e-284c-4dce-b655-c4011180911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:56.219911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1181/2358] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:55:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:56.233121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:56.234666 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:56.281968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:56.316760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132341e-b93e-4752-a22c-48e5ace68819 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:56.325752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:56.326636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:56.327009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:56.327350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:56.347913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:56.350255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:56.373759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1178/2359] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:06.213232 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=32 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:06.358285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=12 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:12.004996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5dfe-e21c-496d-8eb6-d9cc641733bd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:12.005515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5dfe-e21c-496d-8eb6-d9cc641733bd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:12.005614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5dfe-e21c-496d-8eb6-d9cc641733bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:12.024560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d6ad5dfe-e21c-496d-8eb6-d9cc641733bd None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:12.025780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d6ad5dfe-e21c-496d-8eb6-d9cc641733bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:12.093602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1182/2360] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:12.111129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:12.113868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:12.192468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70762e70-a1c9-40a6-8b01-445e26099a70 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:12.198252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59b82d-0289-4ae8-9303-5e09618d87ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:12.198928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59b82d-0289-4ae8-9303-5e09618d87ee service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:12.199206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59b82d-0289-4ae8-9303-5e09618d87ee service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:12.199480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59b82d-0289-4ae8-9303-5e09618d87ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:12.208172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59b82d-0289-4ae8-9303-5e09618d87ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:12.209754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59b82d-0289-4ae8-9303-5e09618d87ee service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:12.219260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1179/2361] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:13.106762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb945db-a6e2-44d3-a89d-b818ffd57fa9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.107198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb945db-a6e2-44d3-a89d-b818ffd57fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.107447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb945db-a6e2-44d3-a89d-b818ffd57fa9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.108914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1183/2362] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:56:13.114581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5cf80-ff18-4db7-900e-c0f1df8e30c3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.115028 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5cf80-ff18-4db7-900e-c0f1df8e30c3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.115161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5cf80-ff18-4db7-900e-c0f1df8e30c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.134748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6ee5cf80-ff18-4db7-900e-c0f1df8e30c3 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:13.136612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6ee5cf80-ff18-4db7-900e-c0f1df8e30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:13.146078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1180/2363] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:13.158129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb945db-a6e2-44d3-a89d-b818ffd57fa9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:13.160642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7cb945db-a6e2-44d3-a89d-b818ffd57fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:13.231424 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb945db-a6e2-44d3-a89d-b818ffd57fa9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:13.237478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eaedf-2af2-417d-99a4-946019824f78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:13.238696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eaedf-2af2-417d-99a4-946019824f78 service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.239128 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eaedf-2af2-417d-99a4-946019824f78 service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.239566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eaedf-2af2-417d-99a4-946019824f78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.253213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13eaedf-2af2-417d-99a4-946019824f78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:13.254639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13eaedf-2af2-417d-99a4-946019824f78 service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:13.272522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1184/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:13.345208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb351f13-3d30-4855-b45f-3dcf17937159 None None] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.345585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb351f13-3d30-4855-b45f-3dcf17937159 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.345937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb351f13-3d30-4855-b45f-3dcf17937159 None None] PATH_INFO: `/` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.347533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1181/2365] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:56:13.352870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760d69a-f79d-4d04-84d6-d3308390fcd1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.353177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760d69a-f79d-4d04-84d6-d3308390fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.353454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760d69a-f79d-4d04-84d6-d3308390fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.372237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2760d69a-f79d-4d04-84d6-d3308390fcd1 None None] MFA Rules not processed for user `1f86dd9b76ef42e8a6fbff301df7d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:13.373450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2760d69a-f79d-4d04-84d6-d3308390fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:13.424861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1185/2366] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:56:13.437215 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb351f13-3d30-4855-b45f-3dcf17937159 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:13.438895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-eb351f13-3d30-4855-b45f-3dcf17937159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:13.452182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb351f13-3d30-4855-b45f-3dcf17937159 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:13.455681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7241c-39af-4cc9-bbd8-f365646ddf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:13.456344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7241c-39af-4cc9-bbd8-f365646ddf65 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.456630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7241c-39af-4cc9-bbd8-f365646ddf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.456907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7241c-39af-4cc9-bbd8-f365646ddf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.463820 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7241c-39af-4cc9-bbd8-f365646ddf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:13.465847 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7241c-39af-4cc9-bbd8-f365646ddf65 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:13.473628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1182/2367] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:13.587661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2399b-8ddc-4334-a596-c315e6206d7a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.587959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2399b-8ddc-4334-a596-c315e6206d7a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.588277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2399b-8ddc-4334-a596-c315e6206d7a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.590325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1186/2368] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 14 10:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:56:13.596004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050424-ed83-45a5-9d50-27782f1865a8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.596318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050424-ed83-45a5-9d50-27782f1865a8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.596596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050424-ed83-45a5-9d50-27782f1865a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.615595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-33050424-ed83-45a5-9d50-27782f1865a8 None None] MFA Rules not processed for user `11d05026ac51451a8c10fb63f840d15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:13.616855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-33050424-ed83-45a5-9d50-27782f1865a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:13.626692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1183/2369] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 14 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:13.640782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2399b-8ddc-4334-a596-c315e6206d7a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:13.643095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-27b2399b-8ddc-4334-a596-c315e6206d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:13.657317 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2399b-8ddc-4334-a596-c315e6206d7a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:13.661057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:13.661817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:13.662201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:13.662588 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:13.680861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:13.683646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:13.702195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1187/2370] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:18.182144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d38c9-6e65-4bf7-97b6-106667106724 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:18.183148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d38c9-6e65-4bf7-97b6-106667106724 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:18.183590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d38c9-6e65-4bf7-97b6-106667106724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:18.203618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d78d38c9-6e65-4bf7-97b6-106667106724 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:18.204897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d78d38c9-6e65-4bf7-97b6-106667106724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:18.213166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1184/2371] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:18.234462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:18.246614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b9598-be95-4f24-9ae9-df772d770ca8 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:18.252858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:18.253569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:18.253850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:18.254144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:18.264944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:18.266570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:18.278416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1188/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:21.475846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bff4-fbb6-4e53-a826-eddd194ff585 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:21.476398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bff4-fbb6-4e53-a826-eddd194ff585 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:21.476511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18bff4-fbb6-4e53-a826-eddd194ff585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:21.496766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7c18bff4-fbb6-4e53-a826-eddd194ff585 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:21.497987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7c18bff4-fbb6-4e53-a826-eddd194ff585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:21.506568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1185/2373] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:21.523736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:21.535179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b40d40-660a-4ab9-8380-a6eda6e9b3b8 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:21.541110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:21.541796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:21.542434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:21.542720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:21.551586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:21.553343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:21.564581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1189/2374] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:23.218034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75569f-7081-44d2-9096-cec9665e8a10 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:23.218573 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75569f-7081-44d2-9096-cec9665e8a10 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:23.218748 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75569f-7081-44d2-9096-cec9665e8a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:23.244549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ce75569f-7081-44d2-9096-cec9665e8a10 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:23.246988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ce75569f-7081-44d2-9096-cec9665e8a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:23.255752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1186/2375] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:23.284022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:23.297600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330fd5-c8aa-4ff2-bda8-707baff41f7a service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:23.303661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:23.305332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:23.305898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:23.306150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:23.316238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:23.317954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:23.323930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:23.339191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1190/2376] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:33.237339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=55 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:39.991815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:39.992543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:39.992543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:40.138180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:40.139399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:40.147240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1187/2377] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:40.161959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:40.174267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9d8e5-1f49-4e4c-b1f3-efb126f3e3d6 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:40.180776 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:40.181829 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:40.182280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:40.182709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:40.193529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:40.196227 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:40.207930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1191/2378] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:42.235098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:42.236284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:42.354474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d59a-4488-46a5-b679-199e0cf2e769 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:42.372755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:42.373843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:42.374553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:42.375057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:42.377433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:42.392926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:42.394725 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3182b24-edff-4efb-a3c7-7a421bbba183 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:42.409196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1188/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:43.243469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:43.253332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f2766-b900-4f38-bdce-50076df6fb52 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:43.257394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:43.258055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:43.258341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:43.258621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:43.260433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:43.342804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:43.344327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:43.354621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1192/2380] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:44.770078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cf995-4808-4bc7-ac43-f96f03f14a3b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:44.771199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cf995-4808-4bc7-ac43-f96f03f14a3b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:44.771712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cf995-4808-4bc7-ac43-f96f03f14a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:44.792570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-db2cf995-4808-4bc7-ac43-f96f03f14a3b None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:44.794034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-db2cf995-4808-4bc7-ac43-f96f03f14a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:44.802366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1189/2381] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:44.818088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:44.832353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1eae1-39ac-447b-8f1c-5e9d1544ab9e service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:44.839651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:44.840579 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:44.841042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:44.842223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:44.851637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:44.853264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:44.862441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1193/2382] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:45.218420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0eb53-c2b1-4ad4-93e7-577087e8d792 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:45.218706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0eb53-c2b1-4ad4-93e7-577087e8d792 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:45.218982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0eb53-c2b1-4ad4-93e7-577087e8d792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:45.238984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-54a0eb53-c2b1-4ad4-93e7-577087e8d792 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:45.240358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-54a0eb53-c2b1-4ad4-93e7-577087e8d792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:45.249110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1190/2383] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:45.267653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:45.280226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90462-e5da-4994-90bc-7d9971615773 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:45.286725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:45.287541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:45.287819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:45.288193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:45.297946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:45.299546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:45.324376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1194/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:45.470086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7d3e-bea2-43f1-97a2-cce3421bf93a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:45.470600 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7d3e-bea2-43f1-97a2-cce3421bf93a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:45.470977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7d3e-bea2-43f1-97a2-cce3421bf93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:45.492447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8a7d7d3e-bea2-43f1-97a2-cce3421bf93a None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:45.495866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8a7d7d3e-bea2-43f1-97a2-cce3421bf93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:45.512461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1191/2385] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 14 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:45.522461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:45.535565 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475a612-a8f2-44ab-b488-8a41da4cc121 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:45.542135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:45.543558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:45.544011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:45.544523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:45.554831 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:45.557216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:45.568249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1195/2386] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:45.845470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725e54-abcf-4363-8f11-a61b10980bd1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:45.846306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725e54-abcf-4363-8f11-a61b10980bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:45.846767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725e54-abcf-4363-8f11-a61b10980bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:45.871302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-28725e54-abcf-4363-8f11-a61b10980bd1 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:45.873099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-28725e54-abcf-4363-8f11-a61b10980bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:45.886846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1192/2387] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:45.900258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:45.912203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32f00-247e-4ab1-80ca-1cd3376a59a3 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:45.919080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:45.920009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:45.920479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:45.920946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:45.931119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:45.934256 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:45.947517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1196/2388] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:46.337995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5237c-1f41-46ec-a4db-892c21db1ed8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:46.344292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5237c-1f41-46ec-a4db-892c21db1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:46.344744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5237c-1f41-46ec-a4db-892c21db1ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:46.367128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ccb5237c-1f41-46ec-a4db-892c21db1ed8 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:46.368358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ccb5237c-1f41-46ec-a4db-892c21db1ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:46.375865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1193/2389] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 14 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:46.389001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:46.404493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e51243-7c86-4201-b6b3-0f0cf559babf service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:46.410205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:46.410981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:46.411431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:46.411953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:46.422899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:46.424777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:46.438423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1197/2390] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 10:56:46.642115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:46.643198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:46.643900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:46.684644 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:46.687248 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:46.709298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1194/2391] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 14 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:46.725144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:46.737769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516f849-f6f1-4f42-a4d8-3069fb2bfc33 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:46.750163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092a061-9f0f-48d2-9f29-ddbc005e2f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:46.751346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a061-9f0f-48d2-9f29-ddbc005e2f90 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:46.752001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a061-9f0f-48d2-9f29-ddbc005e2f90 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:46.752550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092a061-9f0f-48d2-9f29-ddbc005e2f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:46.768004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a061-9f0f-48d2-9f29-ddbc005e2f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:46.770411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092a061-9f0f-48d2-9f29-ddbc005e2f90 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:46.785398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1198/2392] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:48.896605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:48.908938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78c49-5156-471f-961a-ada1c48361b5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:48.913601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:48.914569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:48.914913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:48.915277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] PATH_INFO: `/v3/users/ac64c1cf66d54b4aabf188bd18fe6a1e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:48.916587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac64c1cf66d54b4aabf188bd18fe6a1e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:48.918631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:48.967614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac64c1cf66d54b4aabf188bd18fe6a1e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:48.968916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac64c1cf66d54b4aabf188bd18fe6a1e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:48.982388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac64c1cf66d54b4aabf188bd18fe6a1e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:48.989553 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac64c1cf66d54b4aabf188bd18fe6a1e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:48.997071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac64c1cf66d54b4aabf188bd18fe6a1e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:49.002975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1195/2393] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:56:48 2022] DELETE /identity/v3/users/ac64c1cf66d54b4aabf188bd18fe6a1e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:56:49.007651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488bf4c-42f8-405a-b7c2-a5c0b38d1e7b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:49.008191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488bf4c-42f8-405a-b7c2-a5c0b38d1e7b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:49.008482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488bf4c-42f8-405a-b7c2-a5c0b38d1e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:49.026614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a488bf4c-42f8-405a-b7c2-a5c0b38d1e7b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:49.027909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a488bf4c-42f8-405a-b7c2-a5c0b38d1e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:49.090555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1199/2394] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:49.100331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:49.103187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:49.124025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:49.171677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747939-2a03-49de-841a-3ebcfa30123a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:49.175693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:49.176403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:49.176711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:49.176987 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:49.187394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:49.188888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:49.201720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1196/2395] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:49.412210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:49.413553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:49.413750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:49.413874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:49.414106 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:49.421653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:49.437527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:49.438769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:49.441973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625fca9-ffc7-4209-b9d9-e5158635822f service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:49.447275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:49.448329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:49.448615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:49.448886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] PATH_INFO: `/v3/projects/cc055b321c894f748d4cb0200007f8c7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:49.450045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc055b321c894f748d4cb0200007f8c7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:49.450623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1200/2396] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:49.452314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:49.471864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:49.473501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:49.502603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc055b321c894f748d4cb0200007f8c7', 'request_id': 'req-4cb45010-f585-4324-ba50-6278ac70658b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:49.508884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc055b321c894f748d4cb0200007f8c7', 'request_id': 'req-4cb45010-f585-4324-ba50-6278ac70658b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:49.516412 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc055b321c894f748d4cb0200007f8c7', 'request_id': 'req-4cb45010-f585-4324-ba50-6278ac70658b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:49.527173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] The token cache is being invalidate because project cc055b321c894f748d4cb0200007f8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:56:49.527457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:49.528092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4cb45010-f585-4324-ba50-6278ac70658b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:49.529615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1197/2397] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:56:49 2022] DELETE /identity/v3/projects/cc055b321c894f748d4cb0200007f8c7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:56:49.548684 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3587f2-ee1f-4d6d-aede-a7a736d72e12 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:49.616849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:49.617513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:49.617794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:49.618066 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:49.619978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:49.688581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:49.690203 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba48690-5a57-4712-9e1b-3589728f7b00 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:49.703542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1201/2398] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:56:59.523670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:59.697580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:03.406541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90835-1c55-44ac-af89-cd049067cee7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:03.406995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90835-1c55-44ac-af89-cd049067cee7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:03.407091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90835-1c55-44ac-af89-cd049067cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:03.426071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-20e90835-1c55-44ac-af89-cd049067cee7 None None] MFA Rules not processed for user `f9c66bf9125f45818c304b3f595f6211`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:03.427394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-20e90835-1c55-44ac-af89-cd049067cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:03.489903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1198/2399] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:05.800508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:05.801123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:05.801123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:05.818144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] MFA Rules not processed for user `ec0e407ebade49b7bb8329aa34a87c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:05.819352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:05.875699 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1202/2400] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:57:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:13.477635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=25 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:15.868358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=25 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:20.200375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fbdc1-cdd7-4b49-be7d-d2f4542e4ab1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:20.200954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fbdc1-cdd7-4b49-be7d-d2f4542e4ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:20.201535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fbdc1-cdd7-4b49-be7d-d2f4542e4ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:20.222102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bd2fbdc1-cdd7-4b49-be7d-d2f4542e4ab1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:20.223466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bd2fbdc1-cdd7-4b49-be7d-d2f4542e4ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:20.232040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1199/2401] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:57:20.246679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:20.248630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:20.264745 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066d894-4eb3-4bb2-9ffa-d2d02414f78a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:20.270229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:20.270871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:20.271157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:20.271436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:20.280299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:20.281877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:20.291298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1203/2402] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:24.565722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954701-aaa5-4cc7-b157-e8a0a52049e2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:24.566277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954701-aaa5-4cc7-b157-e8a0a52049e2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:24.566277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954701-aaa5-4cc7-b157-e8a0a52049e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:24.585648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-db954701-aaa5-4cc7-b157-e8a0a52049e2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:24.586877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-db954701-aaa5-4cc7-b157-e8a0a52049e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:24.595173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1200/2403] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:24.620922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:24.622923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:24.638718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0476b-fff7-4770-9bb1-62e91d555c8e service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:24.644485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:24.645243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:24.645600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:24.645945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:24.655087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:24.656725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:24.667037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1204/2404] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:27.593891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85ad6-46aa-4bc4-9149-9338eb80fd4f None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:27.594378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85ad6-46aa-4bc4-9149-9338eb80fd4f None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:27.594474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85ad6-46aa-4bc4-9149-9338eb80fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:27.613127 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-0ce85ad6-46aa-4bc4-9149-9338eb80fd4f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:27.614332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-0ce85ad6-46aa-4bc4-9149-9338eb80fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:27.622398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1201/2405] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:27.636542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:27.648178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37862d-7d9c-4ab8-826f-81740afe16c3 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:27.654599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f212-e46f-43e2-887f-25ed39df16cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:27.655460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f212-e46f-43e2-887f-25ed39df16cf service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:27.656030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f212-e46f-43e2-887f-25ed39df16cf service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:27.656346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f212-e46f-43e2-887f-25ed39df16cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:27.665502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03f212-e46f-43e2-887f-25ed39df16cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:27.667321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03f212-e46f-43e2-887f-25ed39df16cf service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:27.678573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1205/2406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:29.681478 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:29.681946 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:29.682045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:29.700243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] MFA Rules not processed for user `5147d665ec624416a87056fb249f06b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:29.701594 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:29.757933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1202/2407] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:30.757371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae68f-d120-415e-ab19-745c98753342 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:30.757876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae68f-d120-415e-ab19-745c98753342 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:30.757986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae68f-d120-415e-ab19-745c98753342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:30.777208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d14ae68f-d120-415e-ab19-745c98753342 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:30.778412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d14ae68f-d120-415e-ab19-745c98753342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:30.786242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1206/2408] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:57:30.819342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:30.832100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea8f4f-8bd4-4e73-bc4e-33c195138470 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:30.837650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:30.838326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:30.838604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:30.838878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:30.846978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:30.848566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:30.858379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1203/2409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:36.062533 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcda93-d30a-41f3-a356-7c9fa4e4fb80 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:36.063686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcda93-d30a-41f3-a356-7c9fa4e4fb80 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:36.064148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcda93-d30a-41f3-a356-7c9fa4e4fb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:36.120408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aefcda93-d30a-41f3-a356-7c9fa4e4fb80 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:36.123908 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aefcda93-d30a-41f3-a356-7c9fa4e4fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:36.139498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1207/2410] 10.222.0.66 () {58 vars in 1016 bytes} [Thu Jul 14 10:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:36.168440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:36.183090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1c11-d13a-4cb1-b1c4-34d8df92e2d5 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:36.190017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:36.190926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:36.191391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:36.191866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:36.203195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:36.205703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:36.217576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1204/2411] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:40.451472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:40.451929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:40.452024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:40.478472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] MFA Rules not processed for user `df5446a1745d4fde8d036fa81deb0727`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:40.478472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:40.540972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1208/2412] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:57:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:46.211550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=46 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:50.533843 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=49 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:06.955711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:06.957164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:06.970911 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fae53-bcc2-4c99-9c30-9220deb15864 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:06.975759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:06.976695 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:06.976973 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:06.977267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] PATH_INFO: `/v3/users/ec0e407ebade49b7bb8329aa34a87c8d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:06.978460 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0e407ebade49b7bb8329aa34a87c8d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:06.981846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:07.031652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0e407ebade49b7bb8329aa34a87c8d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.032327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0e407ebade49b7bb8329aa34a87c8d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.046628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0e407ebade49b7bb8329aa34a87c8d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.053543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0e407ebade49b7bb8329aa34a87c8d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.060871 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0e407ebade49b7bb8329aa34a87c8d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.067037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1205/2413] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:58:06 2022] DELETE /identity/v3/users/ec0e407ebade49b7bb8329aa34a87c8d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:07.239137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:07.250737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf34b8-1f97-4b62-8723-aad64a8faf49 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:07.309305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:07.310162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:07.310446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:07.310724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] PATH_INFO: `/v3/projects/022896268f354d618b564bf9d558f201` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:07.311903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=022896268f354d618b564bf9d558f201)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:07.313845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:07.360259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022896268f354d618b564bf9d558f201', 'request_id': 'req-0223a29e-5f13-46cc-8d38-a9332270a28d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.366733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022896268f354d618b564bf9d558f201', 'request_id': 'req-0223a29e-5f13-46cc-8d38-a9332270a28d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.374559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022896268f354d618b564bf9d558f201', 'request_id': 'req-0223a29e-5f13-46cc-8d38-a9332270a28d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.385787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] The token cache is being invalidate because project 022896268f354d618b564bf9d558f201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:58:07.386080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.387372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:07.388968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1209/2414] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:58:07 2022] DELETE /identity/v3/projects/022896268f354d618b564bf9d558f201 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:13.925225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:13.926778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:13.942237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a130015-b308-45f6-8de2-1e8a933d15cf admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.002356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.003259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.003536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.003810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] PATH_INFO: `/v3/users/f9c66bf9125f45818c304b3f595f6211` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.005149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c66bf9125f45818c304b3f595f6211)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.007104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.053757 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c66bf9125f45818c304b3f595f6211'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.054416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c66bf9125f45818c304b3f595f6211'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.066089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c66bf9125f45818c304b3f595f6211'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.072988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c66bf9125f45818c304b3f595f6211'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.075103 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:14.083175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-537bf087-088c-45c2-b0e2-7d88edc61f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c66bf9125f45818c304b3f595f6211'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.090273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1206/2415] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:58:13 2022] DELETE /identity/v3/users/f9c66bf9125f45818c304b3f595f6211 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:14.265616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.267111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:14.280150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223a29e-5f13-46cc-8d38-a9332270a28d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.336834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.337693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.337983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.338260 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] PATH_INFO: `/v3/projects/707ee6fa31334e388c2a156220954b54` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.339446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] RBAC: Authorizing `identity:delete_project(project_id=707ee6fa31334e388c2a156220954b54)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.341400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.376216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:14.390682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707ee6fa31334e388c2a156220954b54', 'request_id': 'req-77c3d2a0-2f2c-45c2-9823-19eb9155feba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.396053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707ee6fa31334e388c2a156220954b54', 'request_id': 'req-77c3d2a0-2f2c-45c2-9823-19eb9155feba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.403510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707ee6fa31334e388c2a156220954b54', 'request_id': 'req-77c3d2a0-2f2c-45c2-9823-19eb9155feba'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.414281 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] The token cache is being invalidate because project 707ee6fa31334e388c2a156220954b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:58:14.414566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.415189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-77c3d2a0-2f2c-45c2-9823-19eb9155feba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:14.416736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1210/2416] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:58:14 2022] DELETE /identity/v3/projects/707ee6fa31334e388c2a156220954b54 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:14.421614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.421938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.422223 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.441636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:14.442477 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:14.501872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1207/2417] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:58:14.509467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.509757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.510038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.528540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:14.529732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:14.537587 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1211/2418] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:14.541619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.551025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22662f8b-0f5b-4e23-b628-17f1d0975503 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.555625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.556297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.556581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.556861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.557583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:58:14.557892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.559974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.571474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1208/2419] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 10:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:58:14.575993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.585167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643097-fcc0-4f65-896a-24c8dcbc5088 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.589792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.590427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.590716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.590990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.591666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.593595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.618713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1212/2420] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 10:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:58:14.623318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.633106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51431fd-1423-415c-b9a6-1b14923e20e4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.689168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.689830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.690141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.690422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.691169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.693073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.712362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1209/2421] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 10:58:14 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:58:14.716479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.727752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d01df-e1b9-4a22-90df-697e8c685967 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.732853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.733509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.733793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.734075 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.734827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.736473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.747624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1213/2422] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:58:14.751547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.761508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06710-3c46-4920-a172-b438bd025e1c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.766214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8459c-bdc1-499c-aa99-2238b9ffa6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.766861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8459c-bdc1-499c-aa99-2238b9ffa6da admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.767211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8459c-bdc1-499c-aa99-2238b9ffa6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.767525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8459c-bdc1-499c-aa99-2238b9ffa6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.768402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8459c-bdc1-499c-aa99-2238b9ffa6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.770094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8459c-bdc1-499c-aa99-2238b9ffa6da admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.779877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1210/2423] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 10:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:58:14.784194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.794486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1944df-9f69-4908-b4ca-55102a82ffe9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.799349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.800270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.800558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.800865 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] PATH_INFO: `/v3/projects/4310043e6bae4b858c5e849ee33764a1/users/5b5507af272a4a71919508d780d17bfe/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.816905 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4310043e6bae4b858c5e849ee33764a1, user_id=5b5507af272a4a71919508d780d17bfe, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:14.819583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:14.832393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1214/2424] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 10:58:14 2022] PUT /identity/v3/projects/4310043e6bae4b858c5e849ee33764a1/users/5b5507af272a4a71919508d780d17bfe/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:14.837390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345049d-bb5d-4c29-ac5e-9f5992298fdc None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.837681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345049d-bb5d-4c29-ac5e-9f5992298fdc None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.837959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345049d-bb5d-4c29-ac5e-9f5992298fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.854913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-4345049d-bb5d-4c29-ac5e-9f5992298fdc None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:14.856610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4345049d-bb5d-4c29-ac5e-9f5992298fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:14.905550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:14.916194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1211/2425] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:14.926297 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:14.928009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:14.984593 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367bf9b-595f-488d-8a77-67bc688c9f4c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:14.988164 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:14.988801 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:14.989085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:14.989363 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:14.998817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:15.000278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:15.009600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1215/2426] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:18.839678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638cc6-7466-43bc-be69-a34bb7bb35c5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:18.841076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638cc6-7466-43bc-be69-a34bb7bb35c5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:18.841399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638cc6-7466-43bc-be69-a34bb7bb35c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:18.870546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-59638cc6-7466-43bc-be69-a34bb7bb35c5 None None] MFA Rules not processed for user `5b5507af272a4a71919508d780d17bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:18.871895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-59638cc6-7466-43bc-be69-a34bb7bb35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:18.945493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1212/2427] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:18.961249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:18.963009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:19.035449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:19.055077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591b2c-b121-4a86-abb6-bfcc59cba177 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:19.062728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:19.063401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:19.063688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:19.063970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:19.072929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:19.074590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:19.085004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1216/2428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:21.724404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:21.724948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:21.725032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:21.757001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] MFA Rules not processed for user `5b5507af272a4a71919508d780d17bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:21.759298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:21.775286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1213/2429] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:21.869308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:21.874334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:21.959478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87227811-69e8-4ca0-bba3-b3d2d2c5ff4e service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:21.963857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:21.965502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:21.965977 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:21.966265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:21.968205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:21.987239 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:21.989402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2e35d-4053-4822-8b70-b55e7d174a20 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:22.004432 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1217/2430] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:23.896422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:23.899599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:23.913120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f2ea-55c5-4e51-9f4d-0a45107e9f63 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:23.916718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:23.917368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:23.917850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:23.918643 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:23.920737 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:23.939224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:23.940641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:23.954889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1214/2431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:28.799691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:28.800200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:28.800362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:28.817258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:28.818430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:28.873267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1218/2432] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 14 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:28.920584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:28.922018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:28.989105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5decf7b-c00b-4d47-b0b8-a40b4da56aab service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:28.994036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:28.994683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:28.994989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:28.995273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:29.003229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:29.004852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:29.013307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1215/2433] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:58:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:58:34.869578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:34.876173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:34.894738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e752ca-e018-4222-a38d-2c25fee8d656 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:34.900934 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:34.901602 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:34.901891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:34.902210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:34.904267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:34.964541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:34.966732 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:34.975967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1219/2434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:36.533984 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:36.535569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:36.554445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697cb7-caa2-4a0d-a7de-8031158edd95 service swift] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:36.559176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:36.562265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:36.562557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:36.562837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] PATH_INFO: `/v3/users/3c92a7c6cabf482b93672f9723f73455` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:36.564055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c92a7c6cabf482b93672f9723f73455)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:36.566032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:36.616122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c92a7c6cabf482b93672f9723f73455'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:36.617320 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c92a7c6cabf482b93672f9723f73455'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:36.623240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:36.632630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c92a7c6cabf482b93672f9723f73455'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:36.640730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c92a7c6cabf482b93672f9723f73455'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:36.651222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c92a7c6cabf482b93672f9723f73455'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:36.660703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1216/2435] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:58:36 2022] DELETE /identity/v3/users/3c92a7c6cabf482b93672f9723f73455 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:36.915172 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:36.935606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714d764-1bf0-462f-b3e4-f6fd68c4081a service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:36.970325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:37.003289 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:37.004205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:37.004691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:37.004970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] PATH_INFO: `/v3/projects/841fe20fcef14f37a50757b434ed7074` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:37.006355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841fe20fcef14f37a50757b434ed7074)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:37.008301 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:37.061952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841fe20fcef14f37a50757b434ed7074', 'request_id': 'req-dd11a9b0-468d-4846-a800-74c352e88869'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.068653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841fe20fcef14f37a50757b434ed7074', 'request_id': 'req-dd11a9b0-468d-4846-a800-74c352e88869'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.083425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841fe20fcef14f37a50757b434ed7074', 'request_id': 'req-dd11a9b0-468d-4846-a800-74c352e88869'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.097463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] The token cache is being invalidate because project 841fe20fcef14f37a50757b434ed7074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:58:37.098133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.098759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.100604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1220/2436] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:58:36 2022] DELETE /identity/v3/projects/841fe20fcef14f37a50757b434ed7074 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:37.104382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:37.106425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:37.126861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43799c-46cd-4db1-9cab-02621d8b6ce7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:37.189528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:37.190641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:37.190919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:37.191189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] PATH_INFO: `/v3/users/6e2b6d0abfc14899a2358901732bbdf7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:37.192461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2b6d0abfc14899a2358901732bbdf7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:37.194382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:37.279739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2b6d0abfc14899a2358901732bbdf7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.280566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2b6d0abfc14899a2358901732bbdf7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.299336 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2b6d0abfc14899a2358901732bbdf7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.307062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2b6d0abfc14899a2358901732bbdf7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.317262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2b6d0abfc14899a2358901732bbdf7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.324954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1217/2437] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 10:58:37 2022] DELETE /identity/v3/users/6e2b6d0abfc14899a2358901732bbdf7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:37.501383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:37.503061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:37.517730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a9b0-468d-4846-a800-74c352e88869 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:37.578273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:37.579140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:37.579423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:37.579697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] PATH_INFO: `/v3/projects/bbadb66308274896b34651cc5346b93f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:37.580940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbadb66308274896b34651cc5346b93f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:37.582855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:37.632293 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbadb66308274896b34651cc5346b93f', 'request_id': 'req-a9fc0118-cefa-449a-ab0d-a8758e93aca2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.638345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbadb66308274896b34651cc5346b93f', 'request_id': 'req-a9fc0118-cefa-449a-ab0d-a8758e93aca2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.641906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:37.645997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbadb66308274896b34651cc5346b93f', 'request_id': 'req-a9fc0118-cefa-449a-ab0d-a8758e93aca2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.659280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] The token cache is being invalidate because project bbadb66308274896b34651cc5346b93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:58:37.659569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.660244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a9fc0118-cefa-449a-ab0d-a8758e93aca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:37.661765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1221/2438] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 10:58:37 2022] DELETE /identity/v3/projects/bbadb66308274896b34651cc5346b93f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:43.656837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:43.658241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:43.708006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:43.733092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bea42d-ce90-41d1-8c9c-89eebd91957e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:43.796540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:43.797190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:43.797473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:43.797744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:43.799502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:43.855792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:43.857403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:43.866355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1218/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:45.340085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:45.340576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:45.340680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:45.359344 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] MFA Rules not processed for user `5147d665ec624416a87056fb249f06b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:45.360595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:45.367560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1222/2440] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:45.669882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:45.671281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:45.728161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0599496-b501-415e-9432-ccc0186bda21 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:45.731682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:45.732353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:45.732632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:45.732902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:45.734657 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:45.743907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:45.745344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:45.753612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1219/2441] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:46.061292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:46.062669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:46.132576 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd5e17-7bc4-452d-834a-15534b8d3d30 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:46.138292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:46.138942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:46.139229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:46.139508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:46.141320 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:46.152687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:46.154271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbfe23-4c0e-448e-8888-0812d6cb8b53 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:46.164072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1223/2442] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:54.970990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:54.972462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:54.983683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7da19-9659-4d79-bdbf-cce5cae513a7 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:54.987646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:54.988435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:54.988842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:54.989267 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:54.991176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:55.001157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:55.002566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:55.010479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1220/2443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:56.159860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=39 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:01.334606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:01.335222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:01.335222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:01.353986 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:01.355687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:01.410022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1224/2444] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:01.422439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:01.423883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:01.438175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:01.494648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa942-9b19-4b17-a618-a91f9cffd1bc service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:01.500205 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be77fb-33cc-49df-a024-0585602ac399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:01.500874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be77fb-33cc-49df-a024-0585602ac399 service swift] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:01.501160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be77fb-33cc-49df-a024-0585602ac399 service swift] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:01.501437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be77fb-33cc-49df-a024-0585602ac399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:01.509395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be77fb-33cc-49df-a024-0585602ac399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:01.511100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be77fb-33cc-49df-a024-0585602ac399 service swift] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:01.520324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1221/2445] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:59:11.403509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=25 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:11.515756 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=26 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:14.875874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:14.880357 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:14.897430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5b81d-1687-4b68-8a5a-ee7032978a4d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:14.903435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:14.904107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:14.904387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:14.904667 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:14.906418 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:14.921126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:14.922788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:14.934820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1225/2446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:16.479362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f9a0-135f-4a56-9c87-8194d6aac43b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:16.479846 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f9a0-135f-4a56-9c87-8194d6aac43b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:16.479952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f9a0-135f-4a56-9c87-8194d6aac43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:16.497659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-3b29f9a0-135f-4a56-9c87-8194d6aac43b None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:16.498834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3b29f9a0-135f-4a56-9c87-8194d6aac43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:16.505857 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1222/2447] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 14 10:59:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:16.518051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:16.529221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd1e05-cc69-4c46-9456-4ec29fa86e57 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:16.534254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:16.534887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:16.535174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:16.535455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:16.543404 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:16.544990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:16.553006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1226/2448] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:59:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:59:26.492168 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:26.549752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=12 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:32.789660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:32.790108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:32.790222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:32.808700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] MFA Rules not processed for user `55723830ec2c4ccab79e51f19c58b3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:32.809904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:32.817051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1223/2449] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 14 10:59:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:32.838736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:32.849618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1dfb7-59c6-4964-b79f-4be64634a95f service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:32.855300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eac24ebb573140718662633d85735b71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:32.856003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:32.856305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:32.856710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:32.868978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:32.871224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:32.879835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1227/2450] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 14 10:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:59:42.803053 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:42.876195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:51.224211 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:51.240446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb49ae-5211-4fd7-9dae-a97e578ee0eb None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:51.247175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:51.248035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:51.248402 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:51.248715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:51.250716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:51.264882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:51.266498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:51.291085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1224/2451] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:57.452918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:57.462104 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df0703-d72b-4ae3-a113-318e82f27d14 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:57.465621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:57.466245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:57.466525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:57.466795 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:57.468546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:57.531012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:57.532420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:57.542583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1228/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:00.730090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:00.732311 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:00.749825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21906a90-a939-4031-9a81-a50dc891106d service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:00.755590 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:00.755806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:00.756120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:00.756382 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:00.758178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:00.770649 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:00.772257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:00.782098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1225/2453] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:00.823428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:00.824938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:00.837573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc2771-1f70-4368-9e83-7dea3924fb12 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:00.841762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:00.842634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:00.842922 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:00.843202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] PATH_INFO: `/v3/users/5147d665ec624416a87056fb249f06b1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:00.844407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5147d665ec624416a87056fb249f06b1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:00.846325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:00.893636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5147d665ec624416a87056fb249f06b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:00.894290 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5147d665ec624416a87056fb249f06b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:00.906129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5147d665ec624416a87056fb249f06b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:00.912924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5147d665ec624416a87056fb249f06b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:00.919848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3f5218be-75cf-424a-a0f2-0d8716416b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5147d665ec624416a87056fb249f06b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:00.925734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1229/2454] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:00 2022] DELETE /identity/v3/users/5147d665ec624416a87056fb249f06b1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:01.102228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.113395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f207d0-15e5-4c99-8a0f-9338ed1a25d3 service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.169610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.170468 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.170754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.171140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] PATH_INFO: `/v3/projects/533dfe17589b405ab48bf69eaefd4f2e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.172356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533dfe17589b405ab48bf69eaefd4f2e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.174315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.218767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533dfe17589b405ab48bf69eaefd4f2e', 'request_id': 'req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:01.226056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533dfe17589b405ab48bf69eaefd4f2e', 'request_id': 'req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:01.233253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533dfe17589b405ab48bf69eaefd4f2e', 'request_id': 'req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:01.243788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] The token cache is being invalidate because project 533dfe17589b405ab48bf69eaefd4f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:01.244085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:01.245263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0db8dbc9-ce5a-483c-bb6e-ce76cb13d9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:01.246901 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1226/2455] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:01 2022] DELETE /identity/v3/projects/533dfe17589b405ab48bf69eaefd4f2e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:01.251765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.252056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.252364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.271211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:01.272517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:01.334041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1230/2456] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:01.341687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.341979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.342260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.360976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:01.362183 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:01.372288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1227/2457] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:01.376440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.386720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c60e20-476d-4904-8cb5-69594e4f6cef None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.391482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.392200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.392488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.392768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.393495 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:01.393804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.395430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.396974 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:01.411822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1231/2458] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:00:01.412966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.422710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0269cf-aa64-43e1-af0d-6d3bcc1b45ee None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.427575 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.428262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.428549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.428830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.429516 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.431704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.457729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1228/2459] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:01.461920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.472034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862e6c-5a0e-4a03-b106-1dac22cdaeb1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.529828 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.530498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.530784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.531068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.531754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.533717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.553288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1232/2460] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:01.557486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.567719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7c958-fd9c-4992-83b2-d4cf2ce1b8e8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.572581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.573234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.573519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.573801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.574523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.576135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.586343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1229/2461] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:01.590655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.601200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57b90-4501-4c42-a398-6802456c255d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.606461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f8d2-09d3-4f9d-8f91-449b818adca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.607116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f8d2-09d3-4f9d-8f91-449b818adca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.607400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f8d2-09d3-4f9d-8f91-449b818adca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.607680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f8d2-09d3-4f9d-8f91-449b818adca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.608435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0f8d2-09d3-4f9d-8f91-449b818adca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.610014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0f8d2-09d3-4f9d-8f91-449b818adca0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.619774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1233/2462] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:01.623801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.633880 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0870658-c7bb-4243-87f5-c9920c4d31f8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.638505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.639401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.639687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.639969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] PATH_INFO: `/v3/projects/2572db01a7c545aa91459d503028cd2d/users/547b3675c28e4f69beb23f84ee5fa359/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.654660 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2572db01a7c545aa91459d503028cd2d, user_id=547b3675c28e4f69beb23f84ee5fa359, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.657343 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.665832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:01.671715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1230/2463] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:01 2022] PUT /identity/v3/projects/2572db01a7c545aa91459d503028cd2d/users/547b3675c28e4f69beb23f84ee5fa359/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:01.682714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.683010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.683296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.709591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] MFA Rules not processed for user `547b3675c28e4f69beb23f84ee5fa359`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:01.710822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:01.774451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1234/2464] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:01.779285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.837806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5551-2c87-4e21-b552-8a4b307a5bc7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.842870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.843505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.843785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.844079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.844767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.846637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.872082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1231/2465] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:01.876287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.887619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587aea2-9595-4086-b105-815add0d1d06 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.952225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.952890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.953168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.953442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.954155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:01.956089 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:01.964118 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:01.977913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1235/2466] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:01 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:01.982101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:01.992374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683915b-2924-425b-92cf-e1e16bc74632 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:01.996913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:01.997588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:01.997867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:01.998142 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:01.998858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:02.000466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:02.013164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1232/2467] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:02.017296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:02.028126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765d173-6ad5-4028-8250-d9479c113055 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:02.032627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:02.033499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:02.033783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:02.034067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] PATH_INFO: `/v3/projects/03ad1ab3985e453189eb193dc3028f0c/users/3200690014534d438464d9ce59b7dafd/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:02.048518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ad1ab3985e453189eb193dc3028f0c, user_id=3200690014534d438464d9ce59b7dafd, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:02.051163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:02.064848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1236/2468] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:02 2022] PUT /identity/v3/projects/03ad1ab3985e453189eb193dc3028f0c/users/3200690014534d438464d9ce59b7dafd/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:02.068845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:02.079472 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e255-2efe-45b2-b067-ec2321e03d5c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:02.134796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16d783-a54e-49d1-aca9-17c7e16189cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:02.135948 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d783-a54e-49d1-aca9-17c7e16189cf admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:02.136262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d783-a54e-49d1-aca9-17c7e16189cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:02.136544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d783-a54e-49d1-aca9-17c7e16189cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:02.137265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16d783-a54e-49d1-aca9-17c7e16189cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:02.138885 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16d783-a54e-49d1-aca9-17c7e16189cf admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:02.149546 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1233/2469] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:02.154468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:02.164692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1bfc1-f2a2-46b5-9968-34e44f742fd9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:02.169264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:02.170141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:02.170426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:02.170707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] PATH_INFO: `/v3/projects/03ad1ab3985e453189eb193dc3028f0c/users/3200690014534d438464d9ce59b7dafd/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:02.172675 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ad1ab3985e453189eb193dc3028f0c, user_id=3200690014534d438464d9ce59b7dafd, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:02.175277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:02.185394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1237/2470] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:02 2022] PUT /identity/v3/projects/03ad1ab3985e453189eb193dc3028f0c/users/3200690014534d438464d9ce59b7dafd/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:02.195572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:02.195844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:02.196405 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:02.222957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] MFA Rules not processed for user `3200690014534d438464d9ce59b7dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:02.224219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:02.280978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:02.291237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1234/2471] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:02.302609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:02.304353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:02.372194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d302-362d-45f3-a3fc-601d885539f9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:02.376746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:02.377413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:02.377698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:02.377976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:02.389056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:02.390585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:02.400532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1238/2472] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:02.470613 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:02.479970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdd042-51b1-4799-890f-2eca7c815119 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:02.483582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f5de-e7bd-46bf-904a-ed31561d3e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:02.484241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f5de-e7bd-46bf-904a-ed31561d3e5b service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:02.484528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f5de-e7bd-46bf-904a-ed31561d3e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:02.484801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f5de-e7bd-46bf-904a-ed31561d3e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:02.540747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438f5de-e7bd-46bf-904a-ed31561d3e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:02.542665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438f5de-e7bd-46bf-904a-ed31561d3e5b service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:02.551462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1235/2473] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:03.292251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:03.354566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe528f5-928a-4ae8-a0f6-2bda0142df33 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:03.359473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:03.360361 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:03.360641 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:03.360914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] PATH_INFO: `/v3/users/547b3675c28e4f69beb23f84ee5fa359` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:03.362084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547b3675c28e4f69beb23f84ee5fa359)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:03.363981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:03.410469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547b3675c28e4f69beb23f84ee5fa359'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.411120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547b3675c28e4f69beb23f84ee5fa359'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.419165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:03.424354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547b3675c28e4f69beb23f84ee5fa359'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.432531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547b3675c28e4f69beb23f84ee5fa359'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.439545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547b3675c28e4f69beb23f84ee5fa359'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.445562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1239/2474] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:03 2022] DELETE /identity/v3/users/547b3675c28e4f69beb23f84ee5fa359 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:03.451542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:03.452026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:03.452157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:03.470141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:03.471342 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:03.529027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1236/2475] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:03.538603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:03.540081 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:03.596616 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af5a3-653f-4d81-a22f-ef7b7bb64eb9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:03.600154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:03.600794 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:03.601076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:03.601352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:03.610261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:03.611685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:03.621180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1240/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:03.889354 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:03.890955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:03.904108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b8bd6-3f54-44e3-9c99-d0a64c2c04b0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:03.910726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:03.912297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:03.912809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:03.913332 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] PATH_INFO: `/v3/projects/2572db01a7c545aa91459d503028cd2d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:03.915463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2572db01a7c545aa91459d503028cd2d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:03.919326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:03.966166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2572db01a7c545aa91459d503028cd2d', 'request_id': 'req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.972408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2572db01a7c545aa91459d503028cd2d', 'request_id': 'req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.979809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2572db01a7c545aa91459d503028cd2d', 'request_id': 'req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.990356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] The token cache is being invalidate because project 2572db01a7c545aa91459d503028cd2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:03.990710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.991434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:03.992995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1237/2477] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:03 2022] DELETE /identity/v3/projects/2572db01a7c545aa91459d503028cd2d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:03.998385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.008136 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb761c8-2fe2-4285-978c-ddffc1369752 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.064913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.065780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.066083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.066340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] PATH_INFO: `/v3/users/3200690014534d438464d9ce59b7dafd` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.067521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3200690014534d438464d9ce59b7dafd)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.069506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.115561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3200690014534d438464d9ce59b7dafd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.116238 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3200690014534d438464d9ce59b7dafd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.128665 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3200690014534d438464d9ce59b7dafd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.135346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3200690014534d438464d9ce59b7dafd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.141875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1d09b91d-9413-478f-9937-2961d6b55059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3200690014534d438464d9ce59b7dafd'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.143399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:04.150263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1241/2478] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:03 2022] DELETE /identity/v3/users/3200690014534d438464d9ce59b7dafd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:04.417774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.419246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:04.441119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e0a4-d2ec-4e6c-acd0-37bf6a40fcbc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.455051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:04.500728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.501591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.501873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.502148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] PATH_INFO: `/v3/projects/03ad1ab3985e453189eb193dc3028f0c` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.503474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ad1ab3985e453189eb193dc3028f0c)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.505426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.549842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ad1ab3985e453189eb193dc3028f0c', 'request_id': 'req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.555703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ad1ab3985e453189eb193dc3028f0c', 'request_id': 'req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.562717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ad1ab3985e453189eb193dc3028f0c', 'request_id': 'req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.573218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] The token cache is being invalidate because project 03ad1ab3985e453189eb193dc3028f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:04.573503 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.574121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1a5a13d-892e-4fd7-9d7c-513bd37e627f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:04.575614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1238/2479] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:04 2022] DELETE /identity/v3/projects/03ad1ab3985e453189eb193dc3028f0c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:04.581194 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.581691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.581807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.600279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:04.601499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:04.659287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1242/2480] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:04.667560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.667787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.668084 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.685950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:04.687155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:04.695069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1239/2481] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:04.699313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.708925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6abd35-e0eb-45fe-9f76-1b9bf72448ad None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.713998 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.714643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.714928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.715202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.715929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:04.716266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.717854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.730327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1243/2482] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:04.735261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.744626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b73f-a895-4cfe-9496-2c525e65a5b2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.749258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.749898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.750185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.750465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.751159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.753099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.778344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1240/2483] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:04 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:04.782569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.793225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aab0b5-e066-4e8c-8a4b-7cc27187a00d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.848013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.848703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.848980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.849251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.849918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.851804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.874405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1244/2484] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:04 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:04.876427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.887181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14114244-5233-458f-bf2f-5bf37adf658d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.891816 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.892501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.892788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.893118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.893977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.895603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.906518 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1241/2485] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:04.910288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.920806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0db8aa-ba0d-45e0-938c-14ee843cc4fb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.925275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003fc69-95e4-4036-b55c-b47c6b7b41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.925920 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003fc69-95e4-4036-b55c-b47c6b7b41b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.926204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003fc69-95e4-4036-b55c-b47c6b7b41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.926482 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003fc69-95e4-4036-b55c-b47c6b7b41b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.927209 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003fc69-95e4-4036-b55c-b47c6b7b41b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.928818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003fc69-95e4-4036-b55c-b47c6b7b41b7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.939319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1245/2486] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:04.943162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:04.953617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa09b1b-092c-410f-aca2-84aa3ca9bd7f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:04.958297 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:04.959160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:04.959443 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:04.959723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] PATH_INFO: `/v3/projects/60bb17458c0841f6918ffc1239ee02b0/users/4353b93e524d449380866d4010f72a7b/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:04.975276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bb17458c0841f6918ffc1239ee02b0, user_id=4353b93e524d449380866d4010f72a7b, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:04.977975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:04.991242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1242/2487] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:04 2022] PUT /identity/v3/projects/60bb17458c0841f6918ffc1239ee02b0/users/4353b93e524d449380866d4010f72a7b/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:05.003370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.003717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.003997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.030696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] MFA Rules not processed for user `4353b93e524d449380866d4010f72a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:05.031926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:05.086036 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:05.097545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1246/2488] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:05.102024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.146047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:05.163064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21f6b-da40-47f3-9ef6-2b0ed973ebfa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.168159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.168807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.169088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.169362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.170044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.171978 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.197623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1243/2489] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:05 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:05.201812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.212560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41de89-09e3-4461-bfbf-f1ca856276fa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.270387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.271052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.271339 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.271621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.272351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.274263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.294833 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1247/2490] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:05 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:05.298828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.308969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8e130-2c6e-4803-b1c2-c22ec465931f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.313612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.314276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.314564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.314841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.315569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.317191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.328102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1244/2491] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:05.332382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.342706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c52d1-1cd7-43ec-b696-8bef38883060 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.347251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.348149 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.348436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.348714 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] PATH_INFO: `/v3/projects/f09105ae23634e3685129026a172b60b/users/a9ecc348ffcd4577bc23f6752f1f46ce/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.363824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09105ae23634e3685129026a172b60b, user_id=a9ecc348ffcd4577bc23f6752f1f46ce, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.366499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.378966 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1248/2492] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:05 2022] PUT /identity/v3/projects/f09105ae23634e3685129026a172b60b/users/a9ecc348ffcd4577bc23f6752f1f46ce/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:05.382811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.392640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8cb09-3638-450e-a940-fdb96256467a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.448620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6713-eedc-441e-b5ae-9cd74d8c8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.449206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6713-eedc-441e-b5ae-9cd74d8c8d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.449490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6713-eedc-441e-b5ae-9cd74d8c8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.449766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6713-eedc-441e-b5ae-9cd74d8c8d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.450481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6713-eedc-441e-b5ae-9cd74d8c8d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.452056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6713-eedc-441e-b5ae-9cd74d8c8d99 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.461556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1245/2493] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:05.466225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.476697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9539-e3a4-44bc-8307-3e7a3cd3b1d7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.481912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.482774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.483052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.483334 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] PATH_INFO: `/v3/projects/f09105ae23634e3685129026a172b60b/users/a9ecc348ffcd4577bc23f6752f1f46ce/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.485319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09105ae23634e3685129026a172b60b, user_id=a9ecc348ffcd4577bc23f6752f1f46ce, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.487919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.497935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1249/2494] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:05 2022] PUT /identity/v3/projects/f09105ae23634e3685129026a172b60b/users/a9ecc348ffcd4577bc23f6752f1f46ce/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:05.507706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.508002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.508321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.534091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] MFA Rules not processed for user `a9ecc348ffcd4577bc23f6752f1f46ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:05.535299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:05.601813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1246/2495] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:05.612698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:05.614706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:05.672766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c9b-57c1-4018-893f-7288bf64a9f4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:05.676681 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f256323-ba53-4111-9312-c9c9e4f8d290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:05.677313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f256323-ba53-4111-9312-c9c9e4f8d290 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:05.677618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f256323-ba53-4111-9312-c9c9e4f8d290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:05.677858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f256323-ba53-4111-9312-c9c9e4f8d290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:05.686682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f256323-ba53-4111-9312-c9c9e4f8d290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:05.688112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f256323-ba53-4111-9312-c9c9e4f8d290 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:05.698095 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1250/2496] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:07.170960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:07.218677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:07.241094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123e80-6426-4e4c-8ea0-cea216893431 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:07.247378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:07.248315 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:07.248602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:07.249129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] PATH_INFO: `/v3/users/4353b93e524d449380866d4010f72a7b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:07.250432 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4353b93e524d449380866d4010f72a7b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:07.252466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:07.303601 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4353b93e524d449380866d4010f72a7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.304348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4353b93e524d449380866d4010f72a7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.318001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4353b93e524d449380866d4010f72a7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.325780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4353b93e524d449380866d4010f72a7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.333284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4353b93e524d449380866d4010f72a7b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.339895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1247/2497] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:07 2022] DELETE /identity/v3/users/4353b93e524d449380866d4010f72a7b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:07.344558 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:07.345064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:07.345175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:07.366742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:07.367942 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:07.413105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:07.430134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1251/2498] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:07.440795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:07.442213 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:07.500904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb3c8e-062b-4b41-95eb-53f9f57d5888 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:07.504771 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:07.505421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:07.505707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:07.506097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:07.515790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:07.517340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:07.533803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1248/2499] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:07.786035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:07.787598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:07.800690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77526c4-ef59-4380-a76a-a597b6cd1ffa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:07.805546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:07.806362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:07.806646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:07.806992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] PATH_INFO: `/v3/projects/60bb17458c0841f6918ffc1239ee02b0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:07.808248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bb17458c0841f6918ffc1239ee02b0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:07.810151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:07.857512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bb17458c0841f6918ffc1239ee02b0', 'request_id': 'req-73808c55-e332-4933-b595-2aa6116655e7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.863180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bb17458c0841f6918ffc1239ee02b0', 'request_id': 'req-73808c55-e332-4933-b595-2aa6116655e7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.871056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bb17458c0841f6918ffc1239ee02b0', 'request_id': 'req-73808c55-e332-4933-b595-2aa6116655e7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.882787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] The token cache is being invalidate because project 60bb17458c0841f6918ffc1239ee02b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:07.883076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.883701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:07.885746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1252/2500] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:07 2022] DELETE /identity/v3/projects/60bb17458c0841f6918ffc1239ee02b0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:07.889744 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:07.899999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40703217-859b-4a58-9c57-b09ae3caa637 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:07.955020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:07.955873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:07.956192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:07.956466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] PATH_INFO: `/v3/users/a9ecc348ffcd4577bc23f6752f1f46ce` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:07.957633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ecc348ffcd4577bc23f6752f1f46ce)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:07.959781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:07.962417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:08.006259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ecc348ffcd4577bc23f6752f1f46ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.006877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ecc348ffcd4577bc23f6752f1f46ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.018883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ecc348ffcd4577bc23f6752f1f46ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.026819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ecc348ffcd4577bc23f6752f1f46ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.034667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-11df7648-7162-4930-bfe5-e743ea624002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ecc348ffcd4577bc23f6752f1f46ce'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.040656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1249/2501] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:07 2022] DELETE /identity/v3/users/a9ecc348ffcd4577bc23f6752f1f46ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:08.311744 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.313309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:08.327277 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808c55-e332-4933-b595-2aa6116655e7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.381789 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.382685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.382972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.383250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] PATH_INFO: `/v3/projects/f09105ae23634e3685129026a172b60b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.384523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09105ae23634e3685129026a172b60b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.386472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.432287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09105ae23634e3685129026a172b60b', 'request_id': 'req-66c77ae4-31b0-4530-b69e-e14c959d867f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.437717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09105ae23634e3685129026a172b60b', 'request_id': 'req-66c77ae4-31b0-4530-b69e-e14c959d867f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.445058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09105ae23634e3685129026a172b60b', 'request_id': 'req-66c77ae4-31b0-4530-b69e-e14c959d867f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.456283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] The token cache is being invalidate because project f09105ae23634e3685129026a172b60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:08.456575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.457195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-66c77ae4-31b0-4530-b69e-e14c959d867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:08.458704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1253/2502] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:08 2022] DELETE /identity/v3/projects/f09105ae23634e3685129026a172b60b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:08.464129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.464581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.464713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.483284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:08.484586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:08.543019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1250/2503] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:08.551394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.551679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.552138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.558498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:08.572946 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:08.574150 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:08.582017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1254/2504] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:08.586364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.596781 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae826f-fa11-4eae-8a71-86d52775fbec None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.602895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.604492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.604809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.605085 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.605851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:08.606188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.607999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.621003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1251/2505] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:08.624951 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.634218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4ab6-6550-440a-a9c9-fcb21ef34b57 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.639629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.640351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.640638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.640919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.641629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.643530 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.671391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1255/2506] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:08 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:08.675496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.685387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431c86-a3ba-489a-beae-85f51f662dbd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.743713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.744459 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.744745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.745025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.745717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.747634 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.762063 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:08.772225 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1252/2507] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:08 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:08.773413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.784373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f61f9-7906-4ce4-b409-79b4e9af84d4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.789044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.789707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.789991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.790272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.791025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.792658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.803179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1256/2508] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:08.807128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.817021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc24bc-56c5-4266-bf12-91f563040752 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.822049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9672cc-9c87-4ef1-8139-36be42a0a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.823255 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9672cc-9c87-4ef1-8139-36be42a0a3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.823542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9672cc-9c87-4ef1-8139-36be42a0a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.823819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9672cc-9c87-4ef1-8139-36be42a0a3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.824586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9672cc-9c87-4ef1-8139-36be42a0a3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.826185 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9672cc-9c87-4ef1-8139-36be42a0a3dd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.837254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1253/2509] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:08.841838 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:08.852269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696f27a-6e93-45ac-8bf6-ab7d09c7869e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:08.857280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:08.857983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.858389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.858562 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] PATH_INFO: `/v3/projects/daa02e965c8c49d3982e11781bf25fec/users/6ca7922ff95740e084ff0a5d8a70d56d/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.875700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa02e965c8c49d3982e11781bf25fec, user_id=6ca7922ff95740e084ff0a5d8a70d56d, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:08.878490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:08.892846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1257/2510] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:08 2022] PUT /identity/v3/projects/daa02e965c8c49d3982e11781bf25fec/users/6ca7922ff95740e084ff0a5d8a70d56d/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:08.904083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:08.904393 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:08.904677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:08.930457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] MFA Rules not processed for user `6ca7922ff95740e084ff0a5d8a70d56d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:08.931697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:08.999132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1254/2511] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:09.003718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.068624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8323f-2949-499a-9aa8-83498a1a1e89 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.074383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.075101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.075428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.075711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.077141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.079087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.103897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1258/2512] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:09 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:09.108000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.118437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e190d1-98b9-4f4e-8822-3ae298dafaac None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.174952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.175616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.175899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.176210 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.176894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.178790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.200513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1255/2513] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:09 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:09.204749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.215394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11b0b-dc59-4cdd-9fa4-7f3a6007cb99 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.220434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.221228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.221577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.221928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.222733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.224440 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.235298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1259/2514] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:09.239603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.250485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d9347-586c-4f47-8286-409153ed72f1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.255178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.256083 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.256372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.256654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] PATH_INFO: `/v3/projects/dd8a91bc85c84b40934c1547c13473ae/users/217e60fb9ed64c95adfc3d3d0652f2c5/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.272783 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8a91bc85c84b40934c1547c13473ae, user_id=217e60fb9ed64c95adfc3d3d0652f2c5, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.276032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.291884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1256/2515] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:09 2022] PUT /identity/v3/projects/dd8a91bc85c84b40934c1547c13473ae/users/217e60fb9ed64c95adfc3d3d0652f2c5/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:09.295877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.307336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0181aaf-82c8-40f3-87bd-8f017a68f51b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.367748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81768bcf-ea83-4d6a-9d2f-35b90e09ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.368548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81768bcf-ea83-4d6a-9d2f-35b90e09ecc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.370072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81768bcf-ea83-4d6a-9d2f-35b90e09ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.370356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81768bcf-ea83-4d6a-9d2f-35b90e09ecc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.371085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81768bcf-ea83-4d6a-9d2f-35b90e09ecc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.372716 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81768bcf-ea83-4d6a-9d2f-35b90e09ecc0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.393071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1260/2516] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:09.394421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.405428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbc4e-3014-4a18-a322-a24d755c0f07 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.410169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.411111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.411462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.411802 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] PATH_INFO: `/v3/projects/dd8a91bc85c84b40934c1547c13473ae/users/217e60fb9ed64c95adfc3d3d0652f2c5/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.413912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8a91bc85c84b40934c1547c13473ae, user_id=217e60fb9ed64c95adfc3d3d0652f2c5, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.417442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.428586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1257/2517] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:09 2022] PUT /identity/v3/projects/dd8a91bc85c84b40934c1547c13473ae/users/217e60fb9ed64c95adfc3d3d0652f2c5/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:09.439010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.439358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.439649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.459365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:09.470087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] MFA Rules not processed for user `217e60fb9ed64c95adfc3d3d0652f2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:09.471342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:09.540706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1261/2518] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:09.552814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.554623 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:09.587401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:09.616716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecf242-1bb9-4393-a105-6cd966829944 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.621926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.622838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.623371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.623650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.633881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.635326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.646648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1258/2519] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:09.701845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:09.703662 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:09.717611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664edc9-5b58-4df0-958b-3eeae5ff64a7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:09.722408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34a3ee-a1a3-48f9-afdc-5339e9f30354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:09.724013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a3ee-a1a3-48f9-afdc-5339e9f30354 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:09.724548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a3ee-a1a3-48f9-afdc-5339e9f30354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:09.725053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a3ee-a1a3-48f9-afdc-5339e9f30354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:09.825688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34a3ee-a1a3-48f9-afdc-5339e9f30354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:09.827473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34a3ee-a1a3-48f9-afdc-5339e9f30354 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:09.840355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1262/2520] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:13.232879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:13.296050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf42f3-f991-4aab-9069-5764c30f846a service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:13.300718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:13.301598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:13.302017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:13.302306 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] PATH_INFO: `/v3/users/6ca7922ff95740e084ff0a5d8a70d56d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:13.303636 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca7922ff95740e084ff0a5d8a70d56d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:13.305595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:13.350943 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca7922ff95740e084ff0a5d8a70d56d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.351582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca7922ff95740e084ff0a5d8a70d56d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.363032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca7922ff95740e084ff0a5d8a70d56d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.369701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca7922ff95740e084ff0a5d8a70d56d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.376030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca7922ff95740e084ff0a5d8a70d56d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.382091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1259/2521] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:13 2022] DELETE /identity/v3/users/6ca7922ff95740e084ff0a5d8a70d56d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:13.387067 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:13.387584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:13.387705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:13.404979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:13.406211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:13.463961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1263/2522] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:13.473403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:13.474893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:13.530851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d683c-aa6a-40d3-b698-8481112f120b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:13.534433 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:13.535067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:13.535356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:13.535632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:13.541408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:13.545937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:13.547493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:13.558607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1260/2523] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:13.823814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:13.825409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:13.845653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cbbfb-a0c6-4303-b7cd-d6d5038e010a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:13.850333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:13.851222 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:13.851504 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:13.851816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] PATH_INFO: `/v3/projects/daa02e965c8c49d3982e11781bf25fec` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:13.853030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa02e965c8c49d3982e11781bf25fec)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:13.855484 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:13.887629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:13.903648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa02e965c8c49d3982e11781bf25fec', 'request_id': 'req-147c68d0-5064-4715-abfb-1430f49da0b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.909510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa02e965c8c49d3982e11781bf25fec', 'request_id': 'req-147c68d0-5064-4715-abfb-1430f49da0b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.917433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa02e965c8c49d3982e11781bf25fec', 'request_id': 'req-147c68d0-5064-4715-abfb-1430f49da0b2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.928674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] The token cache is being invalidate because project daa02e965c8c49d3982e11781bf25fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:13.928964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.929603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:13.931126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1264/2524] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:13 2022] DELETE /identity/v3/projects/daa02e965c8c49d3982e11781bf25fec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:13.935782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:13.945435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216e253-9cdb-45ca-81e8-cf44f4702aef service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.000795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.001584 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.001877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.002152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] PATH_INFO: `/v3/users/217e60fb9ed64c95adfc3d3d0652f2c5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.003351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217e60fb9ed64c95adfc3d3d0652f2c5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.005295 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.049364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217e60fb9ed64c95adfc3d3d0652f2c5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.049994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217e60fb9ed64c95adfc3d3d0652f2c5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.062154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217e60fb9ed64c95adfc3d3d0652f2c5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.068968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217e60fb9ed64c95adfc3d3d0652f2c5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.076598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217e60fb9ed64c95adfc3d3d0652f2c5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.082372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1261/2525] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:13 2022] DELETE /identity/v3/users/217e60fb9ed64c95adfc3d3d0652f2c5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:14.231964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.233471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:14.298385 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c68d0-5064-4715-abfb-1430f49da0b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.350025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.350682 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.350969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.351248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.353077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:14.365070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.366707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:14.430889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.432407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bd3b-41bb-4748-844b-7e8fb4d5d656 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.441758 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06d435-1470-42e9-bbef-433dfb54b2c1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.442225 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1265/2526] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:14.446645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.447547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.447827 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.448129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] PATH_INFO: `/v3/projects/dd8a91bc85c84b40934c1547c13473ae` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.450094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8a91bc85c84b40934c1547c13473ae)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.451218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.467458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:14.500435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8a91bc85c84b40934c1547c13473ae', 'request_id': 'req-86396aa4-a168-4658-9e3e-fc27b527c40c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.506734 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8a91bc85c84b40934c1547c13473ae', 'request_id': 'req-86396aa4-a168-4658-9e3e-fc27b527c40c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.513485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8a91bc85c84b40934c1547c13473ae', 'request_id': 'req-86396aa4-a168-4658-9e3e-fc27b527c40c'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.524677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] The token cache is being invalidate because project dd8a91bc85c84b40934c1547c13473ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:14.524964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.526159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-86396aa4-a168-4658-9e3e-fc27b527c40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:14.528277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1262/2527] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:14 2022] DELETE /identity/v3/projects/dd8a91bc85c84b40934c1547c13473ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:14.532928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.533218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.533503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.552240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:14.553487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:14.570460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:14.618027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1266/2528] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:14.625763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.626057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.626471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.645535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:14.646850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:14.654972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1263/2529] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:14.659243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.669693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81974449-b5c7-4f14-b55f-432aa8858d48 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.674559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.675212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.675494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.675770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.676528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:14.676834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.678445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.691179 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1267/2530] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:14.695446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.704970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423060c1-2ce5-439e-b1c6-557731401f0a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.709687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.710339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.710620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.710895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.711583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.713541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.740787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1264/2531] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:14.745746 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.757381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090a77-b485-454c-9bb7-02e3e180dbda admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.816813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.817525 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.817813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.818092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.818796 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.820911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.840896 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1268/2532] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:14 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:14.845097 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.856302 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07b2a0-6984-4779-97c3-5cff17d2533c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.861314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.861992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.862279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.862565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.863296 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.864942 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.882039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1265/2533] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:14.884654 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.894761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2057d-f021-4c84-8e8c-eddc3981261b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.899356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b64f3-3359-43c6-991b-9dcc8dad4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.900015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b64f3-3359-43c6-991b-9dcc8dad4bff admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.900335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b64f3-3359-43c6-991b-9dcc8dad4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.900621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b64f3-3359-43c6-991b-9dcc8dad4bff admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.901348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b64f3-3359-43c6-991b-9dcc8dad4bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.902937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b64f3-3359-43c6-991b-9dcc8dad4bff admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.916633 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1269/2534] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:14.918016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:14.928988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b6a3-839c-463c-bc7e-9fe5c0956d7c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:14.934359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:14.935247 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.935535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.936017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] PATH_INFO: `/v3/projects/30b2da7f15cb4b999da89b07a6efbc39/users/0f50eb9d45644897b06d303bf6540aac/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:14.950814 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b2da7f15cb4b999da89b07a6efbc39, user_id=0f50eb9d45644897b06d303bf6540aac, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:14.953515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:14.968751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1266/2535] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:14 2022] PUT /identity/v3/projects/30b2da7f15cb4b999da89b07a6efbc39/users/0f50eb9d45644897b06d303bf6540aac/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:14.979798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:14.980213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:14.980572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.007575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] MFA Rules not processed for user `0f50eb9d45644897b06d303bf6540aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:15.008834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:15.075454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1270/2536] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:15.079777 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.141925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb73eab-7d2a-4012-9bdc-2e6d0842500f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.147136 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.147796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.148110 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.148394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.149088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.151500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.180335 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1267/2537] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:15 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:15.181578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.192646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0805-5223-47e5-b3e2-c36b00b133a6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.205677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:15.255832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.256545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.256834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.257111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.257822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.259805 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.280722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1271/2538] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:15 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:15.285070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.297056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c7f48-f676-40ef-b287-5b8242f3d157 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.302125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.302782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.303068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.303347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.304109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.305728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.320240 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1268/2539] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:15.321607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.335193 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3290cf-fa7d-4dbe-9d63-5fe87e5b0fc4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.340738 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.341625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.341906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.342186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] PATH_INFO: `/v3/projects/1514254cae9a4938b176844900a81a8e/users/f62ed8804b18451b863cc6d106f4b8c4/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.358489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1514254cae9a4938b176844900a81a8e, user_id=f62ed8804b18451b863cc6d106f4b8c4, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.361207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.377121 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1272/2540] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:15 2022] PUT /identity/v3/projects/1514254cae9a4938b176844900a81a8e/users/f62ed8804b18451b863cc6d106f4b8c4/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:15.380906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.392681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdce3-b8f6-4384-ab3b-5b77439ed324 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.403514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:15.460877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d966d0-2e53-40ef-900b-74c5d355a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.461568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d966d0-2e53-40ef-900b-74c5d355a9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.461856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d966d0-2e53-40ef-900b-74c5d355a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.462137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d966d0-2e53-40ef-900b-74c5d355a9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.463615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d966d0-2e53-40ef-900b-74c5d355a9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.465913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d966d0-2e53-40ef-900b-74c5d355a9ae admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.478249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1269/2541] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:15.482178 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.493031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6348cc-cc86-4924-8d62-de0a1575e662 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.498426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.499325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.499692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.500050 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] PATH_INFO: `/v3/projects/1514254cae9a4938b176844900a81a8e/users/f62ed8804b18451b863cc6d106f4b8c4/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.505464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1514254cae9a4938b176844900a81a8e, user_id=f62ed8804b18451b863cc6d106f4b8c4, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.509251 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.521754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1273/2542] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:15 2022] PUT /identity/v3/projects/1514254cae9a4938b176844900a81a8e/users/f62ed8804b18451b863cc6d106f4b8c4/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:15.533522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.533813 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.534093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.560002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] MFA Rules not processed for user `f62ed8804b18451b863cc6d106f4b8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:15.561254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:15.631009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1270/2543] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:15.642097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:15.643821 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:15.702678 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50bedb-1e63-4b34-94e8-49ddafc869f7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:15.706467 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db8ba-f263-4509-b09e-ccd9883c7cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:15.707115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db8ba-f263-4509-b09e-ccd9883c7cab service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:15.707396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db8ba-f263-4509-b09e-ccd9883c7cab service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:15.707674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db8ba-f263-4509-b09e-ccd9883c7cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:15.717572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db8ba-f263-4509-b09e-ccd9883c7cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:15.718997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db8ba-f263-4509-b09e-ccd9883c7cab service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:15.728622 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1274/2544] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:16.279370 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:16.347685 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5c9b-eb25-4780-891c-913961c9e2c6 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:16.354012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:16.354918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:16.355201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:16.355535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] PATH_INFO: `/v3/users/0f50eb9d45644897b06d303bf6540aac` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:16.357251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f50eb9d45644897b06d303bf6540aac)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:16.358796 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:16.405334 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:16.418701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f50eb9d45644897b06d303bf6540aac'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:16.419790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f50eb9d45644897b06d303bf6540aac'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:16.434889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f50eb9d45644897b06d303bf6540aac'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:16.448264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f50eb9d45644897b06d303bf6540aac'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:16.460968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f50eb9d45644897b06d303bf6540aac'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:16.471964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1271/2545] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:16 2022] DELETE /identity/v3/users/0f50eb9d45644897b06d303bf6540aac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:16.476672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:16.477798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:16.478124 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:16.500421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:16.501718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:16.563818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1275/2546] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:16.573784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:16.575219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:16.632348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2bc9c-d3de-4682-abea-6ff90c9b5a4e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:16.635969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:16.636635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:16.636917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:16.637189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:16.646305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:16.647715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:16.657804 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1272/2547] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:17.136159 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:17.137681 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:17.149630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7b487-540f-49a2-ab83-dcc947d2ded9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:17.159784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:17.160822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:17.161240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:17.161586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] PATH_INFO: `/v3/projects/30b2da7f15cb4b999da89b07a6efbc39` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:17.162855 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b2da7f15cb4b999da89b07a6efbc39)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:17.164937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:17.175655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:17.217589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b2da7f15cb4b999da89b07a6efbc39', 'request_id': 'req-27fe4685-ffa4-4386-b1f2-74935894b0fa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.231760 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b2da7f15cb4b999da89b07a6efbc39', 'request_id': 'req-27fe4685-ffa4-4386-b1f2-74935894b0fa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.245895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b2da7f15cb4b999da89b07a6efbc39', 'request_id': 'req-27fe4685-ffa4-4386-b1f2-74935894b0fa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.287765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] The token cache is being invalidate because project 30b2da7f15cb4b999da89b07a6efbc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:17.288472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.289240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.295763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1276/2548] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:17 2022] DELETE /identity/v3/projects/30b2da7f15cb4b999da89b07a6efbc39 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:17.299195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:17.313286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50413fab-3832-4d1d-b175-3b068c734db6 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:17.398020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:17.399662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:17.399868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:17.401355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] PATH_INFO: `/v3/users/f62ed8804b18451b863cc6d106f4b8c4` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:17.402914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62ed8804b18451b863cc6d106f4b8c4)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:17.405274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:17.470886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62ed8804b18451b863cc6d106f4b8c4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.471937 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62ed8804b18451b863cc6d106f4b8c4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.482534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:17.489162 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62ed8804b18451b863cc6d106f4b8c4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.499496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62ed8804b18451b863cc6d106f4b8c4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.512580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62ed8804b18451b863cc6d106f4b8c4'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.533292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1273/2549] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:17 2022] DELETE /identity/v3/users/f62ed8804b18451b863cc6d106f4b8c4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:17.681294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:17.684286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:17.701244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4685-ffa4-4386-b1f2-74935894b0fa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:17.812381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:17.813324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:17.813610 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:17.814076 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] PATH_INFO: `/v3/users/df5446a1745d4fde8d036fa81deb0727` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:17.815511 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5446a1745d4fde8d036fa81deb0727)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:17.819671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:17.874442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5446a1745d4fde8d036fa81deb0727'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.875498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5446a1745d4fde8d036fa81deb0727'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.888541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5446a1745d4fde8d036fa81deb0727'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.895509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5446a1745d4fde8d036fa81deb0727'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.903563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81c5e699-7629-473c-b017-cd67157d6ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5446a1745d4fde8d036fa81deb0727'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:17.910903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1277/2550] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:17 2022] DELETE /identity/v3/users/df5446a1745d4fde8d036fa81deb0727 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:17.960470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:17.961907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:17.983809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e03431-8cca-4d1a-a53b-f15c66484e81 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.048872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.050387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.050672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.050950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] PATH_INFO: `/v3/projects/1514254cae9a4938b176844900a81a8e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.052289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1514254cae9a4938b176844900a81a8e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.054226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.105883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1514254cae9a4938b176844900a81a8e', 'request_id': 'req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.113194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1514254cae9a4938b176844900a81a8e', 'request_id': 'req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.120960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1514254cae9a4938b176844900a81a8e', 'request_id': 'req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.132113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] The token cache is being invalidate because project 1514254cae9a4938b176844900a81a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:18.132568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.133324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-4d7c09d8-0a9a-4fa6-8edc-a95f080c46f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.135010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1274/2551] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:17 2022] DELETE /identity/v3/projects/1514254cae9a4938b176844900a81a8e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:18.140025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.140389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.140697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.160486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.161754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.172625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:18.226670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1278/2552] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:18.234856 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.235149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.235435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.253617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.254839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.262933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1275/2553] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:18.267006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.278191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0efa69-9f0f-4261-8756-3ae2ae40b0d8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.282938 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.283653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.283962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.284270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.285005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:18.285459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.287045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.301382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1279/2554] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:00:18.305918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.316216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed3e4-a006-4dab-803b-aec25d8ada36 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.320844 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.322906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.323480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.324522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.324923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.325279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.326224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.328509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.337016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79555-9a98-4072-98fd-623f0fb8fafb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.343554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.344489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.344775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.345058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] PATH_INFO: `/v3/projects/3179b4cebcd8424a87bb62b4b8414bc2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.346279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3179b4cebcd8424a87bb62b4b8414bc2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.348499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.361112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1276/2555] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:18.365056 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.401749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3179b4cebcd8424a87bb62b4b8414bc2', 'request_id': 'req-3181fcdf-0ea6-461d-a3af-5d1321c2be83'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.407269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3179b4cebcd8424a87bb62b4b8414bc2', 'request_id': 'req-3181fcdf-0ea6-461d-a3af-5d1321c2be83'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.407970 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:18.414999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3179b4cebcd8424a87bb62b4b8414bc2', 'request_id': 'req-3181fcdf-0ea6-461d-a3af-5d1321c2be83'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.427134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] The token cache is being invalidate because project 3179b4cebcd8424a87bb62b4b8414bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:18.427405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.428105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3181fcdf-0ea6-461d-a3af-5d1321c2be83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.429661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1280/2556] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:18 2022] DELETE /identity/v3/projects/3179b4cebcd8424a87bb62b4b8414bc2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:18.431435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ede7-3c69-4ee1-94aa-1a12625e1f0c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.434411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed54587-6f5a-488a-9897-be5080ef4452 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.434701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed54587-6f5a-488a-9897-be5080ef4452 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.434982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed54587-6f5a-488a-9897-be5080ef4452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.452581 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8ed54587-6f5a-488a-9897-be5080ef4452 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.453783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ed54587-6f5a-488a-9897-be5080ef4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.487077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.488374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.488374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.488374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.488922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.490910 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.511684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1277/2557] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:18.514455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1281/2558] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:18.517209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.518800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.522085 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.522399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.522679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.530464 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eebfa-7fc7-42cf-860f-b147188a92b9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.535064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.535694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.535976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.536291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.537021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.538600 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.540557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.542276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.548945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1278/2559] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:18.550326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1282/2560] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:18.553098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.553997 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.563561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf9eff-cae9-4322-a222-0106ab480e2c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.563870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33984882-ebc9-4728-a469-1355cb63de6f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.568237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.568519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.568880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.569167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.569276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.569447 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.569566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.569808 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.570163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:18.570501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.570648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.572383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.572493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.582962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1279/2561] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:18.583891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1283/2562] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:00:18.587732 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.587893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.597270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f77ef-d5c2-4e4c-a65d-54be71aea4b0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.597492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b71763-57be-4a6c-b17f-d9cdebbf91d5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.602019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.602228 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a74d5-e691-4b4d-b78c-74ea18ab2494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.602884 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.603017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a74d5-e691-4b4d-b78c-74ea18ab2494 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.603167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.603791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a74d5-e691-4b4d-b78c-74ea18ab2494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.603976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a74d5-e691-4b4d-b78c-74ea18ab2494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.604119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] PATH_INFO: `/v3/projects/d5ae8cb8801f41fb9f52d8559fbe4ce0/users/41813cb9dc8c46e88e365ba475f39c36/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.604697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a74d5-e691-4b4d-b78c-74ea18ab2494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.606570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a74d5-e691-4b4d-b78c-74ea18ab2494 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.609866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:18.620349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ae8cb8801f41fb9f52d8559fbe4ce0, user_id=41813cb9dc8c46e88e365ba475f39c36, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.623246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.635959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1280/2563] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:18 2022] PUT /identity/v3/projects/d5ae8cb8801f41fb9f52d8559fbe4ce0/users/41813cb9dc8c46e88e365ba475f39c36/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:18.636145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1284/2564] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:18.644178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.646230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.646499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.646775 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.673156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] MFA Rules not processed for user `41813cb9dc8c46e88e365ba475f39c36`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.674364 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.705882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a932b-a87b-43b0-ac0b-8052a6df47dd admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.741190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:18.744754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1285/2565] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:18.756436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.757943 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.766160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.766833 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.767118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.767394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.768109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.770021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.791964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1281/2566] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:18.795793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.805373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5adc9-ec71-4de8-8ae3-2b1364c55747 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.810219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.810865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.811151 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.812089 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.812349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.813974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.815790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc98c8-1595-43af-8bc9-109fad581b97 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.819599 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.820336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.820617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.820897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.824569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1282/2567] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:18.828410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.829969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.831396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.838617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973220f-5fc0-4c36-a25a-6c07b9eace88 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.841195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1286/2568] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:18.844630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.845357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.845727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.846075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.846870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.848828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.860114 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1283/2569] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:18.863442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.864018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:18.874246 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec7e1e-810f-446a-bd5b-823c62843401 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.874870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1f2-3c96-4520-a9fc-c2afeb219a83 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:18.879113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973c05-3974-4120-a2f1-b53927a1e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.879490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:18.879990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973c05-3974-4120-a2f1-b53927a1e22b admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.880359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973c05-3974-4120-a2f1-b53927a1e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.880475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.880637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973c05-3974-4120-a2f1-b53927a1e22b admin admin] PATH_INFO: `/v3/projects/3caaabf34475416995460a8a30d28805/users/0878588971074a88a3407e2e21c7f0e7/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.880736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.881064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] PATH_INFO: `/v3/users/41813cb9dc8c46e88e365ba475f39c36` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.882288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41813cb9dc8c46e88e365ba475f39c36)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.884236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.896431 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973c05-3974-4120-a2f1-b53927a1e22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3caaabf34475416995460a8a30d28805, user_id=0878588971074a88a3407e2e21c7f0e7, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:18.899113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973c05-3974-4120-a2f1-b53927a1e22b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:18.913708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1284/2570] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:18 2022] PUT /identity/v3/projects/3caaabf34475416995460a8a30d28805/users/0878588971074a88a3407e2e21c7f0e7/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:18.924410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.924700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.925008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.937411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41813cb9dc8c46e88e365ba475f39c36'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.938099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41813cb9dc8c46e88e365ba475f39c36'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.950218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41813cb9dc8c46e88e365ba475f39c36'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.951260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] MFA Rules not processed for user `0878588971074a88a3407e2e21c7f0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.952515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:18.955429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:18.957583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41813cb9dc8c46e88e365ba475f39c36'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.967214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-be273c5a-40dd-4b4e-a26c-92b0676c66e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41813cb9dc8c46e88e365ba475f39c36'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:18.973475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1287/2571] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:18 2022] DELETE /identity/v3/users/41813cb9dc8c46e88e365ba475f39c36 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:18.977713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:18.978007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:18.978355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:18.996262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:18.997391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.018235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1285/2572] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:19.022609 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.023897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.056766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1288/2573] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:19.066271 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.067669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.089528 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539848c-ef95-441d-9146-b642a5f89b72 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.094145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.094854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.095140 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.095419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.096125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.098019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.112030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:19.126352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1fc8-29c9-4bf2-b629-3ab8c3c23e3a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.128626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1286/2574] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:19.132616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.177935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.178585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.178866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.179141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.198307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeeda-73a8-4dd3-80f9-e1e56f1224fb admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.204991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.205964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.206389 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.206892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.207863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.210977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.235755 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1287/2575] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:19.239522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.240135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:19.242812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.244809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.249470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5daed-4c91-42aa-8539-bd2fdfdc808c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.254496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.255134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.255417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.255751 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.256734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1289/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:19.257019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.258780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.269788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1288/2577] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:19.274117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.284741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6d757-d6e3-4c1b-9605-93b6e4d427f5 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.289449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.290362 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.290664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.290972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] PATH_INFO: `/v3/projects/f8177e325050478b829ffd88571b5524/users/f0752126b16748b68fcb079586300a74/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.308397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8177e325050478b829ffd88571b5524, user_id=f0752126b16748b68fcb079586300a74, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.311522 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.325444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1290/2578] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:19 2022] PUT /identity/v3/projects/f8177e325050478b829ffd88571b5524/users/f0752126b16748b68fcb079586300a74/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:19.329750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.340807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9e27-6c85-496a-8f32-9c679f5510e8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.398792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e184c-2ed2-45a2-a3d9-431fa3af6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.399630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e184c-2ed2-45a2-a3d9-431fa3af6617 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.399917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e184c-2ed2-45a2-a3d9-431fa3af6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.400760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e184c-2ed2-45a2-a3d9-431fa3af6617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.401532 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e184c-2ed2-45a2-a3d9-431fa3af6617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.410135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e184c-2ed2-45a2-a3d9-431fa3af6617 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.424273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1289/2579] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:19.425465 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.436051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239149-0875-4d85-a647-a2951f64f884 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.440666 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.441546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.441830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.442114 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] PATH_INFO: `/v3/projects/f8177e325050478b829ffd88571b5524/users/f0752126b16748b68fcb079586300a74/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.444123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8177e325050478b829ffd88571b5524, user_id=f0752126b16748b68fcb079586300a74, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.447544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.458561 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1291/2580] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:19 2022] PUT /identity/v3/projects/f8177e325050478b829ffd88571b5524/users/f0752126b16748b68fcb079586300a74/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:19.470653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.470941 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.471218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.498794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] MFA Rules not processed for user `f0752126b16748b68fcb079586300a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:19.500108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.536982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.538811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.569129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:19.581981 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1290/2581] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:19.593470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.594825 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.609441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e388b6-770b-4e97-8af5-51b1dc70ebbd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.614491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.615358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.615777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.616055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] PATH_INFO: `/v3/projects/d5ae8cb8801f41fb9f52d8559fbe4ce0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.617302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ae8cb8801f41fb9f52d8559fbe4ce0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.619741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.651718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fd58c-5a74-4d37-86bf-f1a09b67d1a3 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.655450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166971-4165-437f-956f-20fa3f986cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.656266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166971-4165-437f-956f-20fa3f986cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.656549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166971-4165-437f-956f-20fa3f986cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.656829 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166971-4165-437f-956f-20fa3f986cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.666301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166971-4165-437f-956f-20fa3f986cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.667728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166971-4165-437f-956f-20fa3f986cf1 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.668687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ae8cb8801f41fb9f52d8559fbe4ce0', 'request_id': 'req-4e21f494-8272-4c29-84c1-3d4e283efbc5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:19.674885 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ae8cb8801f41fb9f52d8559fbe4ce0', 'request_id': 'req-4e21f494-8272-4c29-84c1-3d4e283efbc5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:19.677187 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1291/2582] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:19.684358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ae8cb8801f41fb9f52d8559fbe4ce0', 'request_id': 'req-4e21f494-8272-4c29-84c1-3d4e283efbc5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:19.697060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] The token cache is being invalidate because project d5ae8cb8801f41fb9f52d8559fbe4ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:19.697878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:19.698568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:19.700527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1292/2583] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:19 2022] DELETE /identity/v3/projects/d5ae8cb8801f41fb9f52d8559fbe4ce0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:19.705436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b0b36-6339-48bd-b0b1-de0a008c14d3 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.705729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b0b36-6339-48bd-b0b1-de0a008c14d3 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.706013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b0b36-6339-48bd-b0b1-de0a008c14d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.729795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fb9b0b36-6339-48bd-b0b1-de0a008c14d3 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:19.731175 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fb9b0b36-6339-48bd-b0b1-de0a008c14d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.751902 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.753411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.792329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1292/2584] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:19.809725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:19.815017 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f494-8272-4c29-84c1-3d4e283efbc5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.819787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.821397 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.821685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.822145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.825201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.856499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.856793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.857078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.877193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:19.878427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:19.886447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1293/2585] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:19.890499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.891060 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.892532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.899461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd8cd-827e-4ae4-a11e-4ef2e465fdce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.901617 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1293/2586] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:19.904194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.904841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.905125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.905404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.906129 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:19.906561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.908566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.924099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1294/2587] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:00:19.926105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:19.937824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee015-8f45-484d-ac98-abf523e458a7 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:19.942649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:19.943307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:19.943594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:19.944126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:19.944623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:19.946798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:19.973646 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1294/2588] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:19.977929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.001427 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675bec-d722-4732-8698-72ad7d7b6aa3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.075436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.076118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.076403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.076679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.077372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.079277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.100031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1295/2589] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:19 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:20.104584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.113524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.115597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:20.115717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747e2b8-2e39-481a-ad51-a5a7feff16e5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.121224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.121891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.122176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.122457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.123185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.124820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.128467 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf361ec-2f91-44d2-ac08-3bba983fc1d4 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.133184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.134034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.134321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.134622 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] PATH_INFO: `/v3/users/0878588971074a88a3407e2e21c7f0e7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.135883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1295/2590] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:20.136004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0878588971074a88a3407e2e21c7f0e7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.137894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.139718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.139896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:20.149740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ef29-5eb8-4232-82b4-31d55cd779c0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.154439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.155080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.155365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.155657 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.156399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.158009 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.169820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1296/2591] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:20.174348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.185015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2605a-c6ed-4817-9d2b-066e22b1bacc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.187388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0878588971074a88a3407e2e21c7f0e7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.188049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0878588971074a88a3407e2e21c7f0e7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.189848 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01e9ac-9af5-4aa5-a799-e966f4519663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.190707 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01e9ac-9af5-4aa5-a799-e966f4519663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.190993 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01e9ac-9af5-4aa5-a799-e966f4519663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.191272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01e9ac-9af5-4aa5-a799-e966f4519663 admin admin] PATH_INFO: `/v3/projects/92c8a3307e71462fb9f2028d9d87390c/users/c4d195211c1f481d884be1e9a32104fa/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.200216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0878588971074a88a3407e2e21c7f0e7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.206793 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01e9ac-9af5-4aa5-a799-e966f4519663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c8a3307e71462fb9f2028d9d87390c, user_id=c4d195211c1f481d884be1e9a32104fa, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.207580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0878588971074a88a3407e2e21c7f0e7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.209634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01e9ac-9af5-4aa5-a799-e966f4519663 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.215694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d1aed04e-c784-45e1-925e-cd53dba6f370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0878588971074a88a3407e2e21c7f0e7'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.222012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1296/2592] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:20 2022] DELETE /identity/v3/users/0878588971074a88a3407e2e21c7f0e7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:20.226447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.226762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.227044 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.234516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1297/2593] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:20 2022] PUT /identity/v3/projects/92c8a3307e71462fb9f2028d9d87390c/users/c4d195211c1f481d884be1e9a32104fa/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:20.236469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.236758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.237037 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.245069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:20.246278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:20.263302 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] MFA Rules not processed for user `c4d195211c1f481d884be1e9a32104fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:20.264531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:20.305009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1297/2594] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:20.314599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.315989 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:20.332757 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1298/2595] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:20.345399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.346748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:20.373572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:20.379614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283916d1-b640-4edf-a359-fe52a6e68908 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.383322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.383994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.384327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.384617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.394270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.395696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.404311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c773-f84b-4104-a91a-f998583313c1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.405860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1298/2596] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:20.408374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4489f887f944f0806b63b669ffb883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.409024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.409321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.409585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.418911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.420381 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.429419 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1299/2597] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:20.686956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.688425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:20.702728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20502d37-08bb-47b9-8d74-f6e3a05b5720 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.707826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.708716 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.709006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.709347 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] PATH_INFO: `/v3/projects/3caaabf34475416995460a8a30d28805` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.710598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3caaabf34475416995460a8a30d28805)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.713678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.731144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:20.774108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3caaabf34475416995460a8a30d28805', 'request_id': 'req-01b0c04e-f3fb-45a8-9617-50bfc996e681'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.781881 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3caaabf34475416995460a8a30d28805', 'request_id': 'req-01b0c04e-f3fb-45a8-9617-50bfc996e681'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.789241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3caaabf34475416995460a8a30d28805', 'request_id': 'req-01b0c04e-f3fb-45a8-9617-50bfc996e681'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.802012 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] The token cache is being invalidate because project 3caaabf34475416995460a8a30d28805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:20.802301 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.803367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.805173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1299/2598] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:20 2022] DELETE /identity/v3/projects/3caaabf34475416995460a8a30d28805 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:20.810216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:20.823510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6efb2-4a6a-461d-864e-c0c163a9dedb service glance] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:20.905264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:20.906320 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:20.906605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:20.906884 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] PATH_INFO: `/v3/users/f0752126b16748b68fcb079586300a74` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:20.908080 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0752126b16748b68fcb079586300a74)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:20.910043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:20.958638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0752126b16748b68fcb079586300a74'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.959295 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0752126b16748b68fcb079586300a74'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.971547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0752126b16748b68fcb079586300a74'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.978255 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0752126b16748b68fcb079586300a74'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.985473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a582a2b8-f14f-4356-a891-ec611004b0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0752126b16748b68fcb079586300a74'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:20.991582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1300/2599] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:20 2022] DELETE /identity/v3/users/f0752126b16748b68fcb079586300a74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:21.266543 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.268082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:21.287617 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c04e-f3fb-45a8-9617-50bfc996e681 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.348648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.349507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.349791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.350066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] PATH_INFO: `/v3/projects/f8177e325050478b829ffd88571b5524` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.351239 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8177e325050478b829ffd88571b5524)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.353986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.403075 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8177e325050478b829ffd88571b5524', 'request_id': 'req-01eece2f-7521-4132-8215-48b635dabaa9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:21.409819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8177e325050478b829ffd88571b5524', 'request_id': 'req-01eece2f-7521-4132-8215-48b635dabaa9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:21.416877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8177e325050478b829ffd88571b5524', 'request_id': 'req-01eece2f-7521-4132-8215-48b635dabaa9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:21.427383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] The token cache is being invalidate because project f8177e325050478b829ffd88571b5524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:21.427668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:21.428369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-01eece2f-7521-4132-8215-48b635dabaa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:21.429909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1300/2600] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:21 2022] DELETE /identity/v3/projects/f8177e325050478b829ffd88571b5524 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:21.434818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.435107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.435597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.456003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:21.457257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:21.502258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:21.527544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1301/2601] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:21.535243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.535534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.535811 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.554284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:21.555420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:21.563456 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1301/2602] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:21.567695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.578026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8f492-fa1f-4c0a-8e16-0f797f6679e7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.582490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.583129 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.583409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.583685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.584435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:21.584741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.586329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.599307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1302/2603] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:21.603514 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.612933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27248-60bc-46a1-9923-6af6ad3bc94e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.617637 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.618281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.618566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.618900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.619586 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.621520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.649061 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1302/2604] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:21 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:21.653734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.663827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943500-1663-4268-aeb3-fb298e6582a6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.722589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.723300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.723604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.723863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.724592 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.726515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.752205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1303/2605] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:21 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:21.753364 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.764873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83c0c9-59dc-4382-a850-76072a14ed6b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.769815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.770482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.770766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.771046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.771778 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.773422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.774878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:21.788538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1303/2606] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:21.789990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.799820 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596426d-f3d7-4c95-b87c-f0a696aa4028 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.805020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e9d67-ed45-4b47-b677-a2fbc44a9b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.805661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9d67-ed45-4b47-b677-a2fbc44a9b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.805926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9d67-ed45-4b47-b677-a2fbc44a9b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.806211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9d67-ed45-4b47-b677-a2fbc44a9b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.807490 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e9d67-ed45-4b47-b677-a2fbc44a9b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.809176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e9d67-ed45-4b47-b677-a2fbc44a9b57 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.824234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1304/2607] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:21.825352 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:21.835769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db36429-54a7-49f0-a9fa-3bbab1897516 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:21.841390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:21.842309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.842591 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.842869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] PATH_INFO: `/v3/projects/376afb55003c479ebf07de0d79417fa1/users/2e75effcfbf7403296dcad8b39efdabc/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.858157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376afb55003c479ebf07de0d79417fa1, user_id=2e75effcfbf7403296dcad8b39efdabc, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:21.860900 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:21.875769 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1304/2608] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:21 2022] PUT /identity/v3/projects/376afb55003c479ebf07de0d79417fa1/users/2e75effcfbf7403296dcad8b39efdabc/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:21.886832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:21.887130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:21.887417 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:21.916162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] MFA Rules not processed for user `2e75effcfbf7403296dcad8b39efdabc`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:21.918082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:21.986263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1305/2609] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:21.990681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.053307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8840d-ec83-40f0-8c71-8564fc9a21f3 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.058996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.059592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.059874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.060179 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.060918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.062824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.092156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1305/2610] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:21 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:22.094888 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.105996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc07c6-e8de-4234-8e3a-2100259953c4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.146278 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:22.167555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.168563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.168979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.169386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.170446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.173639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.200135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1306/2611] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:22 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:22.203991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.214368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d839-9cb5-4645-afbc-0d4cd9caf259 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.219290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.219945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.220262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.220539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.221270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.222872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.235355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1306/2612] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:22.239824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.250428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f836372-0dd5-4728-8304-2172bd4afb19 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.255019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.256025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.256336 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.256615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] PATH_INFO: `/v3/projects/45dfc1066200431991e290855c6cdba6/users/b20b818417584384a762aeae05d39951/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.272572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dfc1066200431991e290855c6cdba6, user_id=b20b818417584384a762aeae05d39951, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.275268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.288747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1307/2613] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:22 2022] PUT /identity/v3/projects/45dfc1066200431991e290855c6cdba6/users/b20b818417584384a762aeae05d39951/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:22.293181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.303538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc065-5fa0-4984-87c9-848278e51d0f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.363360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908b05-10c8-491b-a1ac-387190892577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.364024 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908b05-10c8-491b-a1ac-387190892577 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.364339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908b05-10c8-491b-a1ac-387190892577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.364610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908b05-10c8-491b-a1ac-387190892577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.365361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908b05-10c8-491b-a1ac-387190892577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.366959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908b05-10c8-491b-a1ac-387190892577 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.377409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1307/2614] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:22.382117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.393084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828c51-efa7-45c3-93bc-f2412ad58a33 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.397787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.398703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.399010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.399296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] PATH_INFO: `/v3/projects/45dfc1066200431991e290855c6cdba6/users/b20b818417584384a762aeae05d39951/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.401292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dfc1066200431991e290855c6cdba6, user_id=b20b818417584384a762aeae05d39951, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.403915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.414091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1308/2615] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:22 2022] PUT /identity/v3/projects/45dfc1066200431991e290855c6cdba6/users/b20b818417584384a762aeae05d39951/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:22.426675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.426959 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.427237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.455386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] MFA Rules not processed for user `b20b818417584384a762aeae05d39951`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:22.456653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:22.487430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:22.527535 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1308/2616] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:22.538798 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:22.540537 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:22.598197 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211c36f-afd0-498b-aecf-e461dd666aab admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:22.601892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4b7b7-30dc-4cfd-8b78-e8ce230ab0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:22.602545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b7b7-30dc-4cfd-8b78-e8ce230ab0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:22.602832 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b7b7-30dc-4cfd-8b78-e8ce230ab0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:22.603116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b7b7-30dc-4cfd-8b78-e8ce230ab0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:22.612698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b7b7-30dc-4cfd-8b78-e8ce230ab0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:22.614122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b7b7-30dc-4cfd-8b78-e8ce230ab0c2 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:22.624343 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1309/2617] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:23.028867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:23.091035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787855-85ce-483d-ab81-7e747951c052 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:23.095458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:23.096339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:23.096626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:23.096897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] PATH_INFO: `/v3/users/2e75effcfbf7403296dcad8b39efdabc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:23.098072 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e75effcfbf7403296dcad8b39efdabc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:23.100022 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:23.146236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e75effcfbf7403296dcad8b39efdabc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.146916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e75effcfbf7403296dcad8b39efdabc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.159699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e75effcfbf7403296dcad8b39efdabc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.166868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e75effcfbf7403296dcad8b39efdabc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.174481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e75effcfbf7403296dcad8b39efdabc'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.180578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1309/2618] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:23 2022] DELETE /identity/v3/users/2e75effcfbf7403296dcad8b39efdabc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:23.185676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:23.186155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:23.186287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:23.204786 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:23.205983 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:23.264992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1310/2619] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:23.274722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:23.276667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:23.331985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:23.339321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f4064-8c42-4331-a92e-2fda350d509c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:23.344483 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:23.345266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:23.345554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:23.345838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:23.357735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:23.359383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:23.369307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1310/2620] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:23.673123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:23.674782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:23.689231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f7aa-35be-48fe-8da0-ae14ea9c1dde None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:23.694583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:23.695469 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:23.695755 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:23.696299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] PATH_INFO: `/v3/projects/376afb55003c479ebf07de0d79417fa1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:23.697984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] RBAC: Authorizing `identity:delete_project(project_id=376afb55003c479ebf07de0d79417fa1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:23.699850 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:23.736412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:23.750235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376afb55003c479ebf07de0d79417fa1', 'request_id': 'req-bf23480e-da54-49f2-bf2d-922ee136053a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.757341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376afb55003c479ebf07de0d79417fa1', 'request_id': 'req-bf23480e-da54-49f2-bf2d-922ee136053a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.765937 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376afb55003c479ebf07de0d79417fa1', 'request_id': 'req-bf23480e-da54-49f2-bf2d-922ee136053a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.777604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] The token cache is being invalidate because project 376afb55003c479ebf07de0d79417fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:23.777892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.778509 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.780071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1311/2621] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:23 2022] DELETE /identity/v3/projects/376afb55003c479ebf07de0d79417fa1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:23.784269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:23.794122 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a8c4-74f0-4a35-8ae8-920ba6a51f8d service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:23.854955 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:23.855894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:23.856974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:23.857304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] PATH_INFO: `/v3/users/b20b818417584384a762aeae05d39951` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:23.858583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20b818417584384a762aeae05d39951)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:23.860595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:23.914200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20b818417584384a762aeae05d39951'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.915071 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20b818417584384a762aeae05d39951'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.929305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20b818417584384a762aeae05d39951'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.937409 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20b818417584384a762aeae05d39951'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.944887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-14be0ee7-2873-4aff-a5f6-f36be5ceb842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20b818417584384a762aeae05d39951'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:23.951873 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1311/2622] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:23 2022] DELETE /identity/v3/users/b20b818417584384a762aeae05d39951 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:24.243183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.245401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:24.260792 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23480e-da54-49f2-bf2d-922ee136053a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.318545 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.319420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.319705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.319985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] PATH_INFO: `/v3/projects/45dfc1066200431991e290855c6cdba6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.321498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45dfc1066200431991e290855c6cdba6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.324206 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.373359 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dfc1066200431991e290855c6cdba6', 'request_id': 'req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:24.378676 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dfc1066200431991e290855c6cdba6', 'request_id': 'req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:24.385990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dfc1066200431991e290855c6cdba6', 'request_id': 'req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:24.397062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] The token cache is being invalidate because project 45dfc1066200431991e290855c6cdba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:24.397346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:24.398044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6d1cf2c8-fb72-4a19-bc87-9180ffdc5208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:24.399604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1312/2623] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:24 2022] DELETE /identity/v3/projects/45dfc1066200431991e290855c6cdba6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:24.404928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.405455 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.405552 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.424252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:24.425459 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:24.484425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1312/2624] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:24.492322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.492606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.492880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.511300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:24.512534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:24.520450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1313/2625] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:24.524867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.534681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a7ad-22c6-4b11-a8ff-2e1f1ac0c195 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.539242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.539892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.540222 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.540498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.541730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:24.542035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.543611 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.545934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:24.556853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1313/2626] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:24.561119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.570574 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72410bce-185b-47fd-ba46-39057a18d705 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.575498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.576184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.576464 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.576736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.577428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.579730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.606550 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1314/2627] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:24 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:24.610690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.622105 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc567cda-f597-442e-98e9-5d24738f9ca8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.683694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.684408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.684690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.684963 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.685661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.687556 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.714065 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1314/2628] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:24 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:24.715455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.726523 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3210476-5f63-4030-90f1-519914867939 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.732291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.733230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.733640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.734127 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.735044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.737092 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.749097 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1315/2629] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:24.753670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.763712 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9924-8258-4e75-9d4f-32fc8e9754fa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.772217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ff9e-6faa-41be-84ee-0fb69cbafcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.773126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ff9e-6faa-41be-84ee-0fb69cbafcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.773406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ff9e-6faa-41be-84ee-0fb69cbafcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.773681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ff9e-6faa-41be-84ee-0fb69cbafcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.774413 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ff9e-6faa-41be-84ee-0fb69cbafcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.776596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ff9e-6faa-41be-84ee-0fb69cbafcf4 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.792104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1315/2630] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:24.793913 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:24.807374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ac53-47ff-4a4f-9a7a-da3606623bbd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:24.815006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:24.815892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.816327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.816634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] PATH_INFO: `/v3/projects/70528a667dae4663bc2eada69d714a47/users/1e09ca6bbbae4f8b97216ad07bc34e67/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.825503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:24.835291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70528a667dae4663bc2eada69d714a47, user_id=1e09ca6bbbae4f8b97216ad07bc34e67, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:24.838782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:24.856250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1316/2631] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:24 2022] PUT /identity/v3/projects/70528a667dae4663bc2eada69d714a47/users/1e09ca6bbbae4f8b97216ad07bc34e67/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:24.866931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:24.867700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:24.867700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:24.897531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] MFA Rules not processed for user `1e09ca6bbbae4f8b97216ad07bc34e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:24.898754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:24.972209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1316/2632] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:24.976766 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.039205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc705-f502-4e05-b2b8-5c94a6d3183e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.044568 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.045226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.045506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.045782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.046471 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.048374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.074355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1317/2633] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:24 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:25.078479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.090031 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8e43b-341a-4573-9169-c398c2733442 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.151587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.152200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.152480 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.152754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.153449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.155355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.163974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:25.175104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1317/2634] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:25 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:25.179196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.190117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89201-bcf8-480a-88fd-28fffa2dc24d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.194818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.195481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.195768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.196337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.197557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.199174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.209600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1318/2635] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:25.214440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.226006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993f037-abeb-4aa6-b92e-a3438acc2bd7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.230774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.231668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.231954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.232272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] PATH_INFO: `/v3/projects/af1a87a185134a1cbf3d1586929df78a/users/66aeb706441c48be9646b0d34dda2ff8/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.248655 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1a87a185134a1cbf3d1586929df78a, user_id=66aeb706441c48be9646b0d34dda2ff8, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.251355 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.265424 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1318/2636] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:25 2022] PUT /identity/v3/projects/af1a87a185134a1cbf3d1586929df78a/users/66aeb706441c48be9646b0d34dda2ff8/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:25.269542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.280781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f800-2366-4fe4-bb84-2b9727cb2615 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.338814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64890e30-a408-4a28-9bb2-9ca065c53f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.339478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64890e30-a408-4a28-9bb2-9ca065c53f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.339758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64890e30-a408-4a28-9bb2-9ca065c53f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.340035 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64890e30-a408-4a28-9bb2-9ca065c53f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.340781 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64890e30-a408-4a28-9bb2-9ca065c53f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.342481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64890e30-a408-4a28-9bb2-9ca065c53f63 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.352924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1319/2637] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:25.357152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.367461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da2a9-f927-4195-98ac-1f87cd7be570 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.372086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.372975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.373261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.373538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] PATH_INFO: `/v3/projects/af1a87a185134a1cbf3d1586929df78a/users/66aeb706441c48be9646b0d34dda2ff8/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.375499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1a87a185134a1cbf3d1586929df78a, user_id=66aeb706441c48be9646b0d34dda2ff8, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.378173 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.388790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1319/2638] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:25 2022] PUT /identity/v3/projects/af1a87a185134a1cbf3d1586929df78a/users/66aeb706441c48be9646b0d34dda2ff8/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:25.399697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.400566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.400872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.427168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] MFA Rules not processed for user `66aeb706441c48be9646b0d34dda2ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:25.428412 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:25.480041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:25.505137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1320/2639] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:25.516550 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.518417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:25.583702 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2905f-4803-419c-a197-2dbfe7f5b2b1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.587400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.588055 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.588362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.588641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.598620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.600598 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.611172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1320/2640] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:25.658450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:25.659933 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:25.672183 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512654e8-0781-41e8-8d22-e4dabb42a554 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:25.676026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6402661-b942-4772-81b1-0df0b925361a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:25.676715 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402661-b942-4772-81b1-0df0b925361a service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:25.677090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402661-b942-4772-81b1-0df0b925361a service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:25.677318 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402661-b942-4772-81b1-0df0b925361a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:25.738192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402661-b942-4772-81b1-0df0b925361a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:25.740007 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402661-b942-4772-81b1-0df0b925361a service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:25.752269 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1321/2641] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:29.090806 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:29.153950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14a4fe-ecf1-4e2c-9755-8f644baad52b service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:29.158474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:29.159356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:29.159772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:29.160073 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] PATH_INFO: `/v3/users/1e09ca6bbbae4f8b97216ad07bc34e67` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:29.161292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e09ca6bbbae4f8b97216ad07bc34e67)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:29.163237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:29.212647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e09ca6bbbae4f8b97216ad07bc34e67'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.213956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e09ca6bbbae4f8b97216ad07bc34e67'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.223977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:29.226170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e09ca6bbbae4f8b97216ad07bc34e67'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.234896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e09ca6bbbae4f8b97216ad07bc34e67'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.241917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e09ca6bbbae4f8b97216ad07bc34e67'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.248832 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1321/2642] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:29 2022] DELETE /identity/v3/users/1e09ca6bbbae4f8b97216ad07bc34e67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:29.253345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:29.253857 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:29.253952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:29.271631 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:29.272898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:29.337044 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1322/2643] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:29.346665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:29.348164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:29.406188 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c771-70b0-446c-8559-832c6cc44efa admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:29.409728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:29.410366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:29.410642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:29.410916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:29.419729 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:29.421182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:29.431216 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1322/2644] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:29.712842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:29.714285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:29.727761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50832fa-02a3-4eb1-89c8-9b94fd8089c6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:29.733749 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:29.734709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:29.734964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:29.735188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] PATH_INFO: `/v3/projects/70528a667dae4663bc2eada69d714a47` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:29.736431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70528a667dae4663bc2eada69d714a47)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:29.738835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:29.786137 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70528a667dae4663bc2eada69d714a47', 'request_id': 'req-32010917-eb94-42a0-8753-2ce9b6c61429'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.793196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70528a667dae4663bc2eada69d714a47', 'request_id': 'req-32010917-eb94-42a0-8753-2ce9b6c61429'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.800681 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70528a667dae4663bc2eada69d714a47', 'request_id': 'req-32010917-eb94-42a0-8753-2ce9b6c61429'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.812690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] The token cache is being invalidate because project 70528a667dae4663bc2eada69d714a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:29.812976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.813619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.815143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1323/2645] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:29 2022] DELETE /identity/v3/projects/70528a667dae4663bc2eada69d714a47 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:29.819144 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:29.828854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245ccc-a181-4b7a-b85d-398dd33a32bf service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:29.885791 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:29.886668 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:29.886951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:29.887228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] PATH_INFO: `/v3/users/66aeb706441c48be9646b0d34dda2ff8` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:29.888482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=66aeb706441c48be9646b0d34dda2ff8)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:29.890444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:29.938356 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66aeb706441c48be9646b0d34dda2ff8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.939014 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66aeb706441c48be9646b0d34dda2ff8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.952252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66aeb706441c48be9646b0d34dda2ff8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.959128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66aeb706441c48be9646b0d34dda2ff8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.967351 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-7812cc09-7833-4108-887f-475f19ef4e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66aeb706441c48be9646b0d34dda2ff8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:29.969739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:29.974944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1323/2646] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:29 2022] DELETE /identity/v3/users/66aeb706441c48be9646b0d34dda2ff8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:30.253400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.258122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:30.266989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:30.271284 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32010917-eb94-42a0-8753-2ce9b6c61429 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.335647 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.336846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.337306 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.337679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] PATH_INFO: `/v3/projects/af1a87a185134a1cbf3d1586929df78a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.342382 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1a87a185134a1cbf3d1586929df78a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.344505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.391739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1a87a185134a1cbf3d1586929df78a', 'request_id': 'req-d2f2bb43-707c-4f09-a584-6d4c15bb4447'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:30.397233 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1a87a185134a1cbf3d1586929df78a', 'request_id': 'req-d2f2bb43-707c-4f09-a584-6d4c15bb4447'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:30.405455 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1a87a185134a1cbf3d1586929df78a', 'request_id': 'req-d2f2bb43-707c-4f09-a584-6d4c15bb4447'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:30.416597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] The token cache is being invalidate because project af1a87a185134a1cbf3d1586929df78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:30.416917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:30.417548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d2f2bb43-707c-4f09-a584-6d4c15bb4447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:30.419084 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1324/2647] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:30 2022] DELETE /identity/v3/projects/af1a87a185134a1cbf3d1586929df78a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:30.424652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.425128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.425358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.444988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:30.446454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:30.505033 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1324/2648] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:30.513177 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.513498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.513780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.533157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:30.534396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:30.542388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1325/2649] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:30.546610 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.556264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13725c-c24c-44e8-b716-6fc83bb7fe75 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.560953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.561625 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.561912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.562192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.562957 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:30.563266 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.564912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.577534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1325/2650] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:30.581900 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.591947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48e16e-ea70-43d1-89e1-197490a0355c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.597308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.597980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.598262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.598540 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.599247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.601186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.627320 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1326/2651] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:30.631548 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.642491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd9ed5-8360-4101-9ddf-da0b7ba15b69 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.698724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.699387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.699671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.699949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.700673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.702565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.734614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1326/2652] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:30 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:30.736201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.747924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf647f9-93c5-420c-9aac-391c9dc69fac admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.754717 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.754960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.755291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.755516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.756396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.757991 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.769921 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1327/2653] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:30.773966 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.785011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9f341-da99-46e7-86af-9a79ea58e5b9 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.789895 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd290-4ce0-4469-9047-191c931d8e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.790572 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd290-4ce0-4469-9047-191c931d8e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.790854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd290-4ce0-4469-9047-191c931d8e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.791298 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd290-4ce0-4469-9047-191c931d8e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.792108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd290-4ce0-4469-9047-191c931d8e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.793709 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd290-4ce0-4469-9047-191c931d8e8f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.804287 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1327/2654] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:30.808971 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:30.819496 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551549cb-fe79-44e3-b2b2-69de654774b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:30.826015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:30.826912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.827199 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.827479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] PATH_INFO: `/v3/projects/0918dd853ba14c1bad8f0f8fadf6051c/users/28af2ae6e497428b86000f7dbe34b87d/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.842992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0918dd853ba14c1bad8f0f8fadf6051c, user_id=28af2ae6e497428b86000f7dbe34b87d, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:30.845696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:30.860283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1328/2655] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:30 2022] PUT /identity/v3/projects/0918dd853ba14c1bad8f0f8fadf6051c/users/28af2ae6e497428b86000f7dbe34b87d/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:30.872232 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:30.872540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:30.872823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:30.900379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] MFA Rules not processed for user `28af2ae6e497428b86000f7dbe34b87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:30.901627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:30.961683 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:30.971953 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1328/2656] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:30.976503 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.009554 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:31.042426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b09e2d-7977-40b7-abfd-61c85bf52d48 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.047547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.048245 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.048534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.048816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.049508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.051423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.077112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1329/2657] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:30 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:31.081117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.091918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3557-d0c2-4416-bab2-5e81ae9f0130 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.146520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.147174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.147566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.147845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.148580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.150484 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.170765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1329/2658] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:31 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:31.174995 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.185788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd58aea-b91c-4bd0-a479-3e2cc0d8c60f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.190311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.190961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.191240 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.191515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.192258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.193814 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.207477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1330/2659] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:31.208582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.218519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70e4b6-4254-45b4-81bd-03ca050976a6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.223380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.224284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.224587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.224928 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] PATH_INFO: `/v3/projects/05f4cbd3535b416c8c94d6e75209391f/users/46a5bf0165f643c4a4ad3122b6502536/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.244200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f4cbd3535b416c8c94d6e75209391f, user_id=46a5bf0165f643c4a4ad3122b6502536, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.247626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.261094 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1330/2660] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:31 2022] PUT /identity/v3/projects/05f4cbd3535b416c8c94d6e75209391f/users/46a5bf0165f643c4a4ad3122b6502536/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:31.265591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.275701 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3997b-cb7d-464e-940d-1e7b894a8586 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.330681 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa00175-c260-44af-9a03-80b8eb1d658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.331443 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa00175-c260-44af-9a03-80b8eb1d658b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.331763 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa00175-c260-44af-9a03-80b8eb1d658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.332170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa00175-c260-44af-9a03-80b8eb1d658b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.332903 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa00175-c260-44af-9a03-80b8eb1d658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.334486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa00175-c260-44af-9a03-80b8eb1d658b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.344043 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1331/2661] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:31.348108 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.358696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ddd6a-a384-461c-81b8-6df0035a9c95 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.363237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.364137 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.364423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.364701 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] PATH_INFO: `/v3/projects/05f4cbd3535b416c8c94d6e75209391f/users/46a5bf0165f643c4a4ad3122b6502536/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.366697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f4cbd3535b416c8c94d6e75209391f, user_id=46a5bf0165f643c4a4ad3122b6502536, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.369996 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.380326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1331/2662] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:31 2022] PUT /identity/v3/projects/05f4cbd3535b416c8c94d6e75209391f/users/46a5bf0165f643c4a4ad3122b6502536/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:31.390752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.391049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.391333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.417649 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] MFA Rules not processed for user `46a5bf0165f643c4a4ad3122b6502536`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:31.418863 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:31.489664 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1332/2663] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:31.503671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.505557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:31.565673 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7588087-f07a-441f-a3b6-42a7522393db admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.569350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.570030 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.570373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.570762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.581694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.583870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.595898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1332/2664] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:31.664113 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:31.674262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38f21b-ac95-4a48-9237-fbb70e8bc031 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:31.677915 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf213-9af1-47ed-9d38-81e500b35f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:31.678548 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf213-9af1-47ed-9d38-81e500b35f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:31.678835 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf213-9af1-47ed-9d38-81e500b35f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:31.679116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf213-9af1-47ed-9d38-81e500b35f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:31.703927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:31.738458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf213-9af1-47ed-9d38-81e500b35f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:31.739894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf213-9af1-47ed-9d38-81e500b35f17 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:31.748827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1333/2665] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:32.006896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:32.062842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:32.076581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4f889-3fbf-4e8f-a194-46a21bf631eb service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:32.081270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:32.082141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:32.082428 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:32.082708 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] PATH_INFO: `/v3/users/28af2ae6e497428b86000f7dbe34b87d` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:32.083916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28af2ae6e497428b86000f7dbe34b87d)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:32.086493 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:32.133143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28af2ae6e497428b86000f7dbe34b87d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.133799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28af2ae6e497428b86000f7dbe34b87d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.145473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28af2ae6e497428b86000f7dbe34b87d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.152184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28af2ae6e497428b86000f7dbe34b87d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.159166 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28af2ae6e497428b86000f7dbe34b87d'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.164962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1333/2666] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:32 2022] DELETE /identity/v3/users/28af2ae6e497428b86000f7dbe34b87d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:32.170135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:32.170429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:32.170736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:32.188812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:32.190019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:32.249276 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1334/2667] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:32.258939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:32.260372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:32.317739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18835b-1b7b-4459-8626-ed7bd9e4084a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:32.321992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:32.322835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:32.323258 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:32.323539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:32.333384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:32.334859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:32.345164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1334/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:32.609777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:32.611299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:32.623774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589694b-884c-493d-bce6-b80a9bc3c905 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:32.628402 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:32.629262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:32.629543 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:32.630259 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] PATH_INFO: `/v3/projects/0918dd853ba14c1bad8f0f8fadf6051c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:32.631029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0918dd853ba14c1bad8f0f8fadf6051c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:32.633145 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:32.679788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0918dd853ba14c1bad8f0f8fadf6051c', 'request_id': 'req-d9124182-b92a-47f6-87df-41af150b0fd8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.685207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0918dd853ba14c1bad8f0f8fadf6051c', 'request_id': 'req-d9124182-b92a-47f6-87df-41af150b0fd8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.692366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0918dd853ba14c1bad8f0f8fadf6051c', 'request_id': 'req-d9124182-b92a-47f6-87df-41af150b0fd8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.704335 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] The token cache is being invalidate because project 0918dd853ba14c1bad8f0f8fadf6051c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:32.704620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.705234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.706729 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1335/2669] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:32 2022] DELETE /identity/v3/projects/0918dd853ba14c1bad8f0f8fadf6051c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:32.710635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:32.720689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41156a5a-2288-4649-81e2-7555254b0dcf service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:32.777763 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:32.778619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:32.778897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:32.779174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] PATH_INFO: `/v3/users/46a5bf0165f643c4a4ad3122b6502536` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:32.780365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a5bf0165f643c4a4ad3122b6502536)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:32.782271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:32.795469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:32.829124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a5bf0165f643c4a4ad3122b6502536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.829767 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a5bf0165f643c4a4ad3122b6502536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.842454 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a5bf0165f643c4a4ad3122b6502536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.849394 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a5bf0165f643c4a4ad3122b6502536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.856533 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-d5136e93-2b3d-4df2-a504-5fa02a992a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a5bf0165f643c4a4ad3122b6502536'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:32.862339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1335/2670] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:32 2022] DELETE /identity/v3/users/46a5bf0165f643c4a4ad3122b6502536 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:33.127567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.129224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:33.143552 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124182-b92a-47f6-87df-41af150b0fd8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.192739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:33.206134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.207027 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.207310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.207585 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] PATH_INFO: `/v3/projects/05f4cbd3535b416c8c94d6e75209391f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.208802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f4cbd3535b416c8c94d6e75209391f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.210741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.257705 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f4cbd3535b416c8c94d6e75209391f', 'request_id': 'req-dd38cae5-5b0b-4541-97a8-199a495be982'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:33.263352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f4cbd3535b416c8c94d6e75209391f', 'request_id': 'req-dd38cae5-5b0b-4541-97a8-199a495be982'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:33.270858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f4cbd3535b416c8c94d6e75209391f', 'request_id': 'req-dd38cae5-5b0b-4541-97a8-199a495be982'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:33.282551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] The token cache is being invalidate because project 05f4cbd3535b416c8c94d6e75209391f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:33.282841 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:33.283485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd38cae5-5b0b-4541-97a8-199a495be982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:33.285093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1336/2671] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:33 2022] DELETE /identity/v3/projects/05f4cbd3535b416c8c94d6e75209391f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:33.290077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.290372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.290651 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.309125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:33.310339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:33.369198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1336/2672] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:33.377185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.377420 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.377703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.396200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:33.397401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:33.406110 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1337/2673] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:33.410197 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.419854 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa763-5099-445a-b1f0-adacd88c126e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.424559 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.425204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.425486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.425760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.426485 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:33.426789 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.428404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.439587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1337/2674] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:33.443674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.453645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eacd77-9b87-46fd-ac9f-92f907f42cd9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.458292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.458930 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.459216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.459492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.460216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.462101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.491859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1338/2675] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:33.492986 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.503037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa9f69-644f-4319-b565-08b545009023 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.559531 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.560233 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.560520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.560805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.561498 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.563415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.584441 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1338/2676] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:33.589167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.599325 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dfa0f-c704-42e5-a64b-2dac66bf0c46 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.603878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.604569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.604849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.605133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.605854 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.607423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.617612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1339/2677] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:33.621416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.631436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223d19-61fe-4a8f-a3b7-456d578f82be admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.636588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97462-5405-435f-8f58-c761ecd1d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.637237 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97462-5405-435f-8f58-c761ecd1d75e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.637527 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97462-5405-435f-8f58-c761ecd1d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.637809 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97462-5405-435f-8f58-c761ecd1d75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.638542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97462-5405-435f-8f58-c761ecd1d75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.640164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97462-5405-435f-8f58-c761ecd1d75e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.642180 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:33.652834 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1339/2678] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:33.656446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.666286 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a79d2-ced3-43cb-ba6c-5d30df56fde7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.670918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.671785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.672100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.672386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] PATH_INFO: `/v3/projects/5f0b0c935d734653ae972200ef034ffa/users/153946e36b284e09b11a8a8744448ad8/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.686650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0b0c935d734653ae972200ef034ffa, user_id=153946e36b284e09b11a8a8744448ad8, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.689330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.702752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1340/2679] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:33 2022] PUT /identity/v3/projects/5f0b0c935d734653ae972200ef034ffa/users/153946e36b284e09b11a8a8744448ad8/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:33.714425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.714902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.715011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.742690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] MFA Rules not processed for user `153946e36b284e09b11a8a8744448ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:33.743889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:33.808054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1340/2680] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:33.812529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.874431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ff18-ec39-47fc-a66a-04ff4e58be45 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.879072 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.879777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.880087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.880391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.881184 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.883502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:33.903430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:33.913518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1341/2681] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:33.914906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:33.925824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b029a-d273-406c-8738-0e618aa6cfc7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:33.984699 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:33.985381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:33.985665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:33.985947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:33.986647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:33.988686 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.008182 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1341/2682] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:33 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:34.012818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.022982 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb53c5-9fc5-42c5-a521-bc58eca4b269 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.027888 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.028578 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.028865 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.029380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.030022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.031595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.042120 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1342/2683] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:34.046159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.055926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb61a1a-5446-46c9-8799-8aada279c27d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.061275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40487-754b-4908-ab3c-3bbf921bc342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.061935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40487-754b-4908-ab3c-3bbf921bc342 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.062220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40487-754b-4908-ab3c-3bbf921bc342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.062502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40487-754b-4908-ab3c-3bbf921bc342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.063231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40487-754b-4908-ab3c-3bbf921bc342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.064888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40487-754b-4908-ab3c-3bbf921bc342 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.076178 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1342/2684] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:34.080430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.090636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c16f3-23f6-43a2-ac1f-1ab93f483782 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.095258 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.096162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.096446 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.096727 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] PATH_INFO: `/v3/projects/1a53ff6b23f44a82be9bb1014d75d25a/users/a6e1719aa3944e15ac313aeb77ad1ef6/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.111553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a53ff6b23f44a82be9bb1014d75d25a, user_id=a6e1719aa3944e15ac313aeb77ad1ef6, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.114231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.127859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1343/2685] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:34 2022] PUT /identity/v3/projects/1a53ff6b23f44a82be9bb1014d75d25a/users/a6e1719aa3944e15ac313aeb77ad1ef6/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:34.138047 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.138263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.138536 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.164429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] MFA Rules not processed for user `a6e1719aa3944e15ac313aeb77ad1ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:34.165670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:34.219070 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:34.228348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1343/2686] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:34.233253 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.295388 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a126-6975-4487-be6a-df12f657d028 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.300453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.301173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.301459 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.301773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.302487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.304453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.333976 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1344/2687] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:34 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:34.335292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.346449 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5c4bf-63e0-496e-8ed8-5b5818f14193 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.405733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.406406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.406693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.406971 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.407723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.409733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.430077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1344/2688] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:34 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:34.434710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.445242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6cd3b-106f-40fa-81f5-3fe83db5fe60 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.450195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.450853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.451141 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.451422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.452182 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.453764 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.465088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1345/2689] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:34.469209 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.480271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2e56-b76b-4317-837e-66f29d91a612 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.485006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.485872 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.486160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.486437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] PATH_INFO: `/v3/projects/a7b9b6a178584473bba7a1799f823f08/users/28598e5ad9b748aba8fd00a1251b7cf8/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.502328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b9b6a178584473bba7a1799f823f08, user_id=28598e5ad9b748aba8fd00a1251b7cf8, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.505092 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.517377 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1345/2690] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:34 2022] PUT /identity/v3/projects/a7b9b6a178584473bba7a1799f823f08/users/28598e5ad9b748aba8fd00a1251b7cf8/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:34.521373 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.533024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f37f-eee6-4353-bf2f-f637f11fc54a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.592539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363b69a-c901-420e-8092-baa8da1ddc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.593208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b69a-c901-420e-8092-baa8da1ddc53 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.593501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b69a-c901-420e-8092-baa8da1ddc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.593767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b69a-c901-420e-8092-baa8da1ddc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.594629 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363b69a-c901-420e-8092-baa8da1ddc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.596237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363b69a-c901-420e-8092-baa8da1ddc53 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.607611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1346/2691] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:34.611715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.622398 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79827f2a-f3ce-4444-ac67-fd995ad76985 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.626960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.627828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.628138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.628421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] PATH_INFO: `/v3/projects/a7b9b6a178584473bba7a1799f823f08/users/28598e5ad9b748aba8fd00a1251b7cf8/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.630411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b9b6a178584473bba7a1799f823f08, user_id=28598e5ad9b748aba8fd00a1251b7cf8, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.633066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.645112 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1346/2692] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:34 2022] PUT /identity/v3/projects/a7b9b6a178584473bba7a1799f823f08/users/28598e5ad9b748aba8fd00a1251b7cf8/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:34.658661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.659200 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.659304 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.686161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] MFA Rules not processed for user `28598e5ad9b748aba8fd00a1251b7cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:34.687370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:34.711534 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:34.758526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1347/2693] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:34.769684 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:34.771404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:34.834892 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeea051-d3e0-4d81-871c-dcd99d6b7dcc admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:34.848538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:34.849277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:34.849676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:34.850026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:34.925200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:34.926659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:34.936542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1347/2694] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:36.492494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:36.502518 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8d84-0cc7-4711-912c-b0afb11951ac None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:36.506148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:36.506876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:36.507247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:36.507595 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:36.565242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:36.566674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:36.576624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1348/2695] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:37.113208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:37.117375 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:37.124111 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a22ab-49c2-4acb-94f0-51b88ec38295 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:37.128677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3156-a48c-47bd-8ee7-737025014ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:37.129285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3156-a48c-47bd-8ee7-737025014ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:37.129568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3156-a48c-47bd-8ee7-737025014ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:37.129858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3156-a48c-47bd-8ee7-737025014ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:37.139497 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff3156-a48c-47bd-8ee7-737025014ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:37.141003 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff3156-a48c-47bd-8ee7-737025014ea8 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:37.150724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1348/2696] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:41.001873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:41.073008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665a5e-66dd-4854-a96c-800ee026b1b7 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:41.077546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:41.078413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:41.078782 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:41.079065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] PATH_INFO: `/v3/users/153946e36b284e09b11a8a8744448ad8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:41.080348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153946e36b284e09b11a8a8744448ad8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:41.082315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:41.130187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153946e36b284e09b11a8a8744448ad8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.130768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153946e36b284e09b11a8a8744448ad8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.141544 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:41.144953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153946e36b284e09b11a8a8744448ad8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.152916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153946e36b284e09b11a8a8744448ad8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.159876 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153946e36b284e09b11a8a8744448ad8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.167668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1349/2697] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:41 2022] DELETE /identity/v3/users/153946e36b284e09b11a8a8744448ad8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:41.173404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:41.174058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:41.174058 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:41.194944 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:41.196453 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:41.254754 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1349/2698] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:41.265580 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:41.266975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:41.325830 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9ea9-e023-4868-8982-c51effc12181 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:41.329505 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:41.330154 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:41.330450 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:41.330723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:41.339861 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:41.341403 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:41.352462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1350/2699] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:41.613720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:41.615229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:41.627224 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a02ce6-30b1-4bb4-a46b-74964313e461 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:41.631962 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:41.632876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:41.633161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:41.633444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] PATH_INFO: `/v3/projects/5f0b0c935d734653ae972200ef034ffa` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:41.635161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0b0c935d734653ae972200ef034ffa)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:41.637149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:41.683899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0b0c935d734653ae972200ef034ffa', 'request_id': 'req-540d1c96-2736-4626-bf36-bc77a2bfd6d2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.690238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0b0c935d734653ae972200ef034ffa', 'request_id': 'req-540d1c96-2736-4626-bf36-bc77a2bfd6d2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.698551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0b0c935d734653ae972200ef034ffa', 'request_id': 'req-540d1c96-2736-4626-bf36-bc77a2bfd6d2'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.709102 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] The token cache is being invalidate because project 5f0b0c935d734653ae972200ef034ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:41.709390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.710018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.711557 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1350/2700] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:41 2022] DELETE /identity/v3/projects/5f0b0c935d734653ae972200ef034ffa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:41.716201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:41.725862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc1b1-eeba-4bb0-a5bc-6147f25fbf25 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:41.781320 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:41.782190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:41.782475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:41.782753 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] PATH_INFO: `/v3/users/a6e1719aa3944e15ac313aeb77ad1ef6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:41.783941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e1719aa3944e15ac313aeb77ad1ef6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:41.785906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:41.829720 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e1719aa3944e15ac313aeb77ad1ef6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.830355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e1719aa3944e15ac313aeb77ad1ef6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.843102 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e1719aa3944e15ac313aeb77ad1ef6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.849842 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e1719aa3944e15ac313aeb77ad1ef6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.856249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e1719aa3944e15ac313aeb77ad1ef6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:41.858298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:41.863148 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1351/2701] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:41 2022] DELETE /identity/v3/users/a6e1719aa3944e15ac313aeb77ad1ef6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:42.149882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:42.151492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:42.165118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d1c96-2736-4626-bf36-bc77a2bfd6d2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:42.227228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:42.228051 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:42.228381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:42.228654 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] PATH_INFO: `/v3/projects/1a53ff6b23f44a82be9bb1014d75d25a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:42.229819 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a53ff6b23f44a82be9bb1014d75d25a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:42.231706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:42.247510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:42.280002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a53ff6b23f44a82be9bb1014d75d25a', 'request_id': 'req-5a52f9ac-733c-4770-b47b-0a390cfb7b64'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.286001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a53ff6b23f44a82be9bb1014d75d25a', 'request_id': 'req-5a52f9ac-733c-4770-b47b-0a390cfb7b64'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.293146 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a53ff6b23f44a82be9bb1014d75d25a', 'request_id': 'req-5a52f9ac-733c-4770-b47b-0a390cfb7b64'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.303693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] The token cache is being invalidate because project 1a53ff6b23f44a82be9bb1014d75d25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:42.303983 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.304627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.306159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1351/2702] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:42 2022] DELETE /identity/v3/projects/1a53ff6b23f44a82be9bb1014d75d25a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:42.310653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:42.312138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:42.326411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab050e8-26f7-4551-b20d-835d659e4ded admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:42.382783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:42.383594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:42.383874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:42.384175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] PATH_INFO: `/v3/users/28598e5ad9b748aba8fd00a1251b7cf8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:42.385441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28598e5ad9b748aba8fd00a1251b7cf8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:42.387342 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:42.431267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28598e5ad9b748aba8fd00a1251b7cf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.432620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28598e5ad9b748aba8fd00a1251b7cf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.445094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28598e5ad9b748aba8fd00a1251b7cf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.452584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28598e5ad9b748aba8fd00a1251b7cf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.460223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1e77de56-975b-45b8-ac2e-b8a72a11793f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28598e5ad9b748aba8fd00a1251b7cf8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.466246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1352/2703] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:42 2022] DELETE /identity/v3/users/28598e5ad9b748aba8fd00a1251b7cf8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:42.734018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:42.735773 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:42.750965 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52f9ac-733c-4770-b47b-0a390cfb7b64 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:42.807465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:42.808360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:42.808648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:42.808927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] PATH_INFO: `/v3/projects/a7b9b6a178584473bba7a1799f823f08` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:42.810115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b9b6a178584473bba7a1799f823f08)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:42.812025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:42.857529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b9b6a178584473bba7a1799f823f08', 'request_id': 'req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.863602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b9b6a178584473bba7a1799f823f08', 'request_id': 'req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.870469 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b9b6a178584473bba7a1799f823f08', 'request_id': 'req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.880927 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] The token cache is being invalidate because project a7b9b6a178584473bba7a1799f823f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:42.881208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.881826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-67ce9493-0b55-4418-9a1c-7fb890bdf0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:42.883564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1352/2704] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:42 2022] DELETE /identity/v3/projects/a7b9b6a178584473bba7a1799f823f08 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:42.888167 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:42.888462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:42.888743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:42.906975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:42.908217 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:42.967431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1353/2705] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:42.975341 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:42.975630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:42.975909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:42.994384 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:42.995520 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:43.003466 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1353/2706] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:43.007551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.017208 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecb62c-f2f6-4a87-a65e-e73dca76f8e0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.021788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.022431 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.022735 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.023008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.023724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:43.024031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.026161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.037521 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1354/2707] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:43.042193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.051496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d2e4-69c3-47bd-9795-f08cd7f8a8e5 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.056049 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.056736 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.057009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.057290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.057976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.059866 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.085292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1354/2708] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:43.089825 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.099498 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174db8-7119-4d93-9284-9a6f801e96b4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.102961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:43.157210 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.157878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.158163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.158444 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.159142 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.161074 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.180263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1355/2709] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:43.184174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.190678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:43.194430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06de537-9844-417d-a42d-917ef4f8d9ea admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.200992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.201848 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.202300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.202874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.203496 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.205131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.216406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1355/2710] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:43.220366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.230698 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a272c-4f0a-45f1-988c-81e71996ecc3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.235557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e1fa-3dae-40f0-9273-6174389574a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.236262 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e1fa-3dae-40f0-9273-6174389574a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.236547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e1fa-3dae-40f0-9273-6174389574a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.236827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e1fa-3dae-40f0-9273-6174389574a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.237559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e1fa-3dae-40f0-9273-6174389574a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.239261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e1fa-3dae-40f0-9273-6174389574a0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.249710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1356/2711] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:43.253867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.265204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10d2e-429e-4881-8924-46d954b28b5c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.270101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.271018 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.271304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.271585 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] PATH_INFO: `/v3/projects/fa8b9edd82514db8a2b1b1d3c61d912b/users/fc823d4020bf458fb02802d1ab4eafb7/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.289081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8b9edd82514db8a2b1b1d3c61d912b, user_id=fc823d4020bf458fb02802d1ab4eafb7, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.291800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.305463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1356/2712] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:43 2022] PUT /identity/v3/projects/fa8b9edd82514db8a2b1b1d3c61d912b/users/fc823d4020bf458fb02802d1ab4eafb7/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:43.315872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.316374 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.316473 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.349130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] MFA Rules not processed for user `fc823d4020bf458fb02802d1ab4eafb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:43.350393 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:43.412618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1357/2713] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:43.417062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.478417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2a85b-8eb9-4900-83ba-8197b6bac2da admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.483067 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.483714 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.483999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.484307 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.485099 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.487167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.513739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1357/2714] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:43.517784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.528515 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a4103-8bae-45e6-99ea-7d618300dedf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.586919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.587582 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.587864 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.588170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.588845 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.590734 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.610298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1358/2715] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:43.614235 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.625722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fba1c-4832-46b5-889b-bb4ccba66e86 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.630540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.631202 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.631488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.631787 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.632529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.634118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.645117 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1358/2716] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:43.649201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.655449 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:43.659634 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b084-fd73-4b6e-9125-08db1c73f8d9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.665138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9e0d-f242-490c-8aa4-70cb61c66b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.665797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9e0d-f242-490c-8aa4-70cb61c66b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.666078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9e0d-f242-490c-8aa4-70cb61c66b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.666356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9e0d-f242-490c-8aa4-70cb61c66b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.667078 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b9e0d-f242-490c-8aa4-70cb61c66b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.668693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b9e0d-f242-490c-8aa4-70cb61c66b66 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.678514 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1359/2717] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:43.683011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.692838 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cf766-8f7f-497c-aca7-9215577233d6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.698276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.699130 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.699416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.699697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] PATH_INFO: `/v3/projects/60befebf3d1a433fa01c9050be9c1272/users/c697606c26ed4234be3735f3bd9d809c/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.713828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60befebf3d1a433fa01c9050be9c1272, user_id=c697606c26ed4234be3735f3bd9d809c, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.716521 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.729066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1359/2718] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:43 2022] PUT /identity/v3/projects/60befebf3d1a433fa01c9050be9c1272/users/c697606c26ed4234be3735f3bd9d809c/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:43.740487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.740797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.741077 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.769862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] MFA Rules not processed for user `c697606c26ed4234be3735f3bd9d809c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:43.771008 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:43.833549 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1360/2719] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:43.838026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.899882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2dee0-927f-4895-b0c1-2c41754facc1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:43.904474 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:43.905123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:43.905401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:43.905676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:43.906363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:43.908279 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:43.933353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1360/2720] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:43.937520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:43.948767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dbea4-9d19-45d8-9635-1b52c228780d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.003819 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.004516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.004804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.005083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.005777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.007712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.027777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1361/2721] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:43 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:44.031909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.038626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:44.042549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d0514-c08d-47b1-ae9f-13b05c1d0c5b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.048476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.049132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.049445 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.049726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.050471 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.052078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.062605 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1361/2722] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:44.066696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.077619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c271d-32f2-4493-ab18-83ce77ee28b8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.082328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.083196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.083481 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.083765 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] PATH_INFO: `/v3/projects/da63acd7320c45639086067badf1dc3a/users/06636cc3b89a40cbae0ff8c9723f1440/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.098686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da63acd7320c45639086067badf1dc3a, user_id=06636cc3b89a40cbae0ff8c9723f1440, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.101351 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.113917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1362/2723] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:44 2022] PUT /identity/v3/projects/da63acd7320c45639086067badf1dc3a/users/06636cc3b89a40cbae0ff8c9723f1440/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:44.117717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.127639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af19c-49b5-42b2-ae3a-51b20e8b8fc7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.183143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252b17-f4b6-4c70-8121-32b24d87d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.183803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252b17-f4b6-4c70-8121-32b24d87d5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.184106 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252b17-f4b6-4c70-8121-32b24d87d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.184388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252b17-f4b6-4c70-8121-32b24d87d5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.185104 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f252b17-f4b6-4c70-8121-32b24d87d5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.186799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f252b17-f4b6-4c70-8121-32b24d87d5ea admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.196561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1362/2724] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:44.201454 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.211532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5755-a56b-4e89-aebb-11e9bafb8092 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.216636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.217499 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.217778 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.218051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] PATH_INFO: `/v3/projects/da63acd7320c45639086067badf1dc3a/users/06636cc3b89a40cbae0ff8c9723f1440/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.220026 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da63acd7320c45639086067badf1dc3a, user_id=06636cc3b89a40cbae0ff8c9723f1440, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.222673 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.232685 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1363/2725] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:44 2022] PUT /identity/v3/projects/da63acd7320c45639086067badf1dc3a/users/06636cc3b89a40cbae0ff8c9723f1440/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:44.242620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.242915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.243198 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.270408 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] MFA Rules not processed for user `06636cc3b89a40cbae0ff8c9723f1440`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:44.271616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:44.337800 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1363/2726] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:44.349023 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.350739 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:44.370870 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.372291 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:44.396892 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:44.416414 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea88c-d520-4276-95de-8e6633550d81 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.420487 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ad41f-0534-47c2-84da-cb0b252cb63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.421133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad41f-0534-47c2-84da-cb0b252cb63f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.421415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad41f-0534-47c2-84da-cb0b252cb63f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.421693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad41f-0534-47c2-84da-cb0b252cb63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.438907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08e149-a342-4511-81bc-d9d96e53ee54 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.443519 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.444419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.444700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.444977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] PATH_INFO: `/v3/users/c4d195211c1f481d884be1e9a32104fa` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.446429 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d195211c1f481d884be1e9a32104fa)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.449040 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.465724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:44.480279 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ad41f-0534-47c2-84da-cb0b252cb63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.481754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ad41f-0534-47c2-84da-cb0b252cb63f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.490911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1364/2727] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:44.498076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d195211c1f481d884be1e9a32104fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:44.498801 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d195211c1f481d884be1e9a32104fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:44.511420 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d195211c1f481d884be1e9a32104fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:44.518191 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d195211c1f481d884be1e9a32104fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:44.526283 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d195211c1f481d884be1e9a32104fa'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:44.532380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1364/2728] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:44 2022] DELETE /identity/v3/users/c4d195211c1f481d884be1e9a32104fa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:44.537058 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.537407 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.537777 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.556116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:44.557372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:44.620119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1365/2729] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:00:44.629907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:44.631414 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:44.691363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b64bb-0fad-499f-8a2b-8cfd0d357c7d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:44.695762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57147422-9c5d-4589-923f-9be56c02af41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:44.697450 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57147422-9c5d-4589-923f-9be56c02af41 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:44.697956 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57147422-9c5d-4589-923f-9be56c02af41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:44.698265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57147422-9c5d-4589-923f-9be56c02af41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:44.708208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57147422-9c5d-4589-923f-9be56c02af41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:44.709671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57147422-9c5d-4589-923f-9be56c02af41 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:44.721249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1365/2730] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:45.003057 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.004645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:45.019117 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81bc34-91db-4837-b585-ed0cd27b83df None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.023872 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.025871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.026108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.026557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] PATH_INFO: `/v3/projects/92c8a3307e71462fb9f2028d9d87390c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.027881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c8a3307e71462fb9f2028d9d87390c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.029784 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.078390 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c8a3307e71462fb9f2028d9d87390c', 'request_id': 'req-5f509347-a525-4322-b226-1ef90384de3f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:45.084020 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c8a3307e71462fb9f2028d9d87390c', 'request_id': 'req-5f509347-a525-4322-b226-1ef90384de3f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:45.091803 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c8a3307e71462fb9f2028d9d87390c', 'request_id': 'req-5f509347-a525-4322-b226-1ef90384de3f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:45.102898 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] The token cache is being invalidate because project 92c8a3307e71462fb9f2028d9d87390c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:45.103186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:45.104488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5f509347-a525-4322-b226-1ef90384de3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:45.106012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1366/2731] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:45 2022] DELETE /identity/v3/projects/92c8a3307e71462fb9f2028d9d87390c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:45.110851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.111138 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.111416 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.130365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:45.131491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:45.189076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1366/2732] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:45.197045 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.197340 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.197628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.216049 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:45.217283 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:45.225166 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1367/2733] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:45.229697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.239155 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3890d95-888c-494f-9530-ed52a74d271a None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.243711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.244383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.244693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.244969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.245687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:45.245992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.247565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.258868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1367/2734] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:45.263053 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.272512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949343-b031-47f7-9baa-6a17a9732a44 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.277797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.278445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.278728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.279005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.279726 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.281686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.284940 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:45.307858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1368/2735] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:45 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:45.312009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.322779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2865b-c8ac-4af2-a9c3-155a2e733d7b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.342749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:45.380115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.381041 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.381270 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.381551 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.382294 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.384263 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.404652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1368/2736] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:45 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:45.410173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.420650 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed89e0-6330-4029-abca-b5c2d1120803 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.425311 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.425962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.426244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.426517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.427236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.428859 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.438960 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1369/2737] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:45.442830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.453663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841e31a-b63f-49ad-9066-644e1f34f315 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.458190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5edf40-2a96-492c-b975-cfdc054bc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.458830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5edf40-2a96-492c-b975-cfdc054bc53e admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.459109 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5edf40-2a96-492c-b975-cfdc054bc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.459381 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5edf40-2a96-492c-b975-cfdc054bc53e admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.460121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5edf40-2a96-492c-b975-cfdc054bc53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.461676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5edf40-2a96-492c-b975-cfdc054bc53e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.471936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1369/2738] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:45.476025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.485928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb83d1-9b09-4a8e-bfb7-593199ad2f4e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.490589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.491456 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.491740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.492019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] PATH_INFO: `/v3/projects/ae43fe86723249849ae86dcf758a3bda/users/44618be9281349929e7fd6904e15495a/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.506175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae43fe86723249849ae86dcf758a3bda, user_id=44618be9281349929e7fd6904e15495a, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.508853 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.521981 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1370/2739] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:45 2022] PUT /identity/v3/projects/ae43fe86723249849ae86dcf758a3bda/users/44618be9281349929e7fd6904e15495a/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:45.527538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.527849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.528159 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.545189 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:45.546385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:45.603828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1370/2740] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:45.613462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:45.615146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:45.671073 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0213bc-1f1b-4e80-bff4-01ef24625024 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:45.674736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:45.675368 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:45.675653 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:45.675935 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:45.684975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:45.686384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:45.695787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1371/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:46.008917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:46.010931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:46.074899 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7a1fe-88c5-49fc-a393-4ad5bf2986e2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:46.078799 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:46.079628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:46.079985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:46.080378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:46.082419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:46.148096 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:46.149569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4688d0e-f983-4969-82f1-7ba4db94c5b6 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:46.153596 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:46.164314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1371/2742] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:46.763476 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:46.775597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c638722-90fb-4720-a0cb-488165255fa6 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:46.779643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:46.780435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:46.780817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:46.781216 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:46.783220 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:46.860140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:46.866170 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:46.875520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1372/2743] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:00:49.496925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd135-6143-447c-97de-648c63c38703 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:49.497388 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd135-6143-447c-97de-648c63c38703 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:49.497517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cd135-6143-447c-97de-648c63c38703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:49.540397 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-387cd135-6143-447c-97de-648c63c38703 None None] MFA Rules not processed for user `44618be9281349929e7fd6904e15495a`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:49.541991 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-387cd135-6143-447c-97de-648c63c38703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:49.630579 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1372/2744] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:49.635904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:49.646319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de4361-8d22-4300-a4e5-5439bd0c70b9 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:49.651048 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:49.651719 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:49.652005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:49.652315 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:49.653033 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:49.655196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:49.690176 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1373/2745] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:49 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:49.694126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd135-6143-447c-97de-648c63c38703 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:49.717339 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cd135-6143-447c-97de-648c63c38703 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:49.819858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:49.820577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:49.820909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:49.821490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:49.822862 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:49.824860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:49.846329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1373/2746] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:49 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:49.850356 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:49.863288 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c009-545e-4fd3-bc7f-1fc6597b9b28 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:49.870135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:49.870948 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:49.871303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:49.871797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:49.872747 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:49.874611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:49.888130 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1374/2747] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:49.891064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:49.903788 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404bb2f-a6f7-4d9e-b04f-ff3680d19ea0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:49.908988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:49.909894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:49.910199 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:49.910507 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] PATH_INFO: `/v3/projects/ea26e9e6ad5a49a6b09e3d42a60baa4f/users/ae0a438314e141679ec3efaf69983292/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:49.929897 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea26e9e6ad5a49a6b09e3d42a60baa4f, user_id=ae0a438314e141679ec3efaf69983292, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:49.932703 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:49.952161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1374/2748] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:49 2022] PUT /identity/v3/projects/ea26e9e6ad5a49a6b09e3d42a60baa4f/users/ae0a438314e141679ec3efaf69983292/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:49.953147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:49.965218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cd34e-af8b-4952-b1f2-f180243f4198 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:49.975426 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:50.026618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:50.027326 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:50.027607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:50.027961 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:50.028758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:50.030394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:50.041513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1375/2749] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:50.045793 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:50.057365 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461faa6b-985c-4475-8317-a5a34f3b2be6 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:50.062595 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281f411-65d9-40be-a593-0b7c02ff4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:50.063568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281f411-65d9-40be-a593-0b7c02ff4112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:50.063855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281f411-65d9-40be-a593-0b7c02ff4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:50.064160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281f411-65d9-40be-a593-0b7c02ff4112 admin admin] PATH_INFO: `/v3/projects/ea26e9e6ad5a49a6b09e3d42a60baa4f/users/ae0a438314e141679ec3efaf69983292/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:50.066238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281f411-65d9-40be-a593-0b7c02ff4112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea26e9e6ad5a49a6b09e3d42a60baa4f, user_id=ae0a438314e141679ec3efaf69983292, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:50.068947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281f411-65d9-40be-a593-0b7c02ff4112 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:50.080515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1375/2750] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:50 2022] PUT /identity/v3/projects/ea26e9e6ad5a49a6b09e3d42a60baa4f/users/ae0a438314e141679ec3efaf69983292/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:50.904341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:50.906709 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:50.920952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdee3fc-a303-421f-b5d6-780feca835e5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:50.991889 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:50.992827 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:50.993161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:50.993439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] PATH_INFO: `/v3/users/fc823d4020bf458fb02802d1ab4eafb7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:50.995211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc823d4020bf458fb02802d1ab4eafb7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:50.997224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:51.060914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc823d4020bf458fb02802d1ab4eafb7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.061809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc823d4020bf458fb02802d1ab4eafb7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.075917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc823d4020bf458fb02802d1ab4eafb7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.084836 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc823d4020bf458fb02802d1ab4eafb7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.098000 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc823d4020bf458fb02802d1ab4eafb7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.104964 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1376/2751] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:50 2022] DELETE /identity/v3/users/fc823d4020bf458fb02802d1ab4eafb7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:00:51.109308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:51.109786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:51.109882 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:51.132765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:51.135261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:51.173567 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:51.208650 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1376/2752] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:51.218024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:51.220031 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:51.278229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:51.339996 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e9825-2adf-4be1-a08c-f63fefa946b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:51.347122 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:51.348462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:51.348462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:51.348748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:51.364398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:51.366882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:51.393236 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1377/2753] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:51.837760 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:51.839563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:51.858696 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86201-a913-421f-93bb-eff1aa7963b1 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:51.864679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:51.865700 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:51.865993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:51.866273 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] PATH_INFO: `/v3/projects/fa8b9edd82514db8a2b1b1d3c61d912b` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:51.870366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8b9edd82514db8a2b1b1d3c61d912b)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:51.872522 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:51.945529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8b9edd82514db8a2b1b1d3c61d912b', 'request_id': 'req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.953616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8b9edd82514db8a2b1b1d3c61d912b', 'request_id': 'req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.965710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8b9edd82514db8a2b1b1d3c61d912b', 'request_id': 'req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.986877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] The token cache is being invalidate because project fa8b9edd82514db8a2b1b1d3c61d912b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:51.987195 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.988036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:51.990350 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1377/2754] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:51 2022] DELETE /identity/v3/projects/fa8b9edd82514db8a2b1b1d3c61d912b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:51.994812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:52.007041 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea676c-d345-4251-9cd8-d7462cd6958d service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:52.079310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:52.080637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:52.081087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:52.081588 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] PATH_INFO: `/v3/users/c697606c26ed4234be3735f3bd9d809c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:52.082952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c697606c26ed4234be3735f3bd9d809c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:52.086180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:52.142609 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c697606c26ed4234be3735f3bd9d809c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.143433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c697606c26ed4234be3735f3bd9d809c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.157331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c697606c26ed4234be3735f3bd9d809c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.170849 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c697606c26ed4234be3735f3bd9d809c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.179769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c697606c26ed4234be3735f3bd9d809c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.187237 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1378/2755] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:51 2022] DELETE /identity/v3/users/c697606c26ed4234be3735f3bd9d809c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:52.550153 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:52.551718 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:52.592313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9b8e-d714-43b8-b901-15dd6964b9e0 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:52.658933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:52.660293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:52.660817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:52.661678 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] PATH_INFO: `/v3/projects/60befebf3d1a433fa01c9050be9c1272` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:52.662859 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60befebf3d1a433fa01c9050be9c1272)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:52.664805 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:52.723936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60befebf3d1a433fa01c9050be9c1272', 'request_id': 'req-5360d655-c975-4edd-903b-3e2544bf1240'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.735560 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60befebf3d1a433fa01c9050be9c1272', 'request_id': 'req-5360d655-c975-4edd-903b-3e2544bf1240'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.752888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60befebf3d1a433fa01c9050be9c1272', 'request_id': 'req-5360d655-c975-4edd-903b-3e2544bf1240'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.761706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:52.787568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] The token cache is being invalidate because project 60befebf3d1a433fa01c9050be9c1272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:52.787874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.788906 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:52.793843 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1378/2756] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:52 2022] DELETE /identity/v3/projects/60befebf3d1a433fa01c9050be9c1272 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:52.795721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:52.798519 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:52.820370 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e852e7-3526-4cd7-814f-f9deb9898ac5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:52.916202 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:52.933244 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:52.934538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:52.935722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:52.936275 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] PATH_INFO: `/v3/users/06636cc3b89a40cbae0ff8c9723f1440` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:52.937767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06636cc3b89a40cbae0ff8c9723f1440)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:52.939923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:53.027352 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06636cc3b89a40cbae0ff8c9723f1440'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.028640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06636cc3b89a40cbae0ff8c9723f1440'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.052116 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06636cc3b89a40cbae0ff8c9723f1440'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.064247 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06636cc3b89a40cbae0ff8c9723f1440'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.081492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ebcde01b-466e-490a-a298-7c8aafd0b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06636cc3b89a40cbae0ff8c9723f1440'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.089700 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1379/2757] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:00:52 2022] DELETE /identity/v3/users/06636cc3b89a40cbae0ff8c9723f1440 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:53.679214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:53.681889 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:53.703434 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360d655-c975-4edd-903b-3e2544bf1240 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:53.807054 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:53.809011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:53.809526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:53.810164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] PATH_INFO: `/v3/projects/da63acd7320c45639086067badf1dc3a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:53.812001 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da63acd7320c45639086067badf1dc3a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:53.814839 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:53.890426 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da63acd7320c45639086067badf1dc3a', 'request_id': 'req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.909269 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da63acd7320c45639086067badf1dc3a', 'request_id': 'req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.919908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da63acd7320c45639086067badf1dc3a', 'request_id': 'req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.938547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] The token cache is being invalidate because project da63acd7320c45639086067badf1dc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:00:53.938883 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.939867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-0cff6b3d-67ad-4c68-bc54-9415c31e6fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:00:53.941444 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1379/2758] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:00:53 2022] DELETE /identity/v3/projects/da63acd7320c45639086067badf1dc3a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:53.947398 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:53.947785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:53.948146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:53.971834 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:53.972425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:54.052643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1380/2759] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:54.061945 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.062233 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.062511 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.099383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:54.100722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:54.117366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1380/2760] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:54.118466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.134310 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b745e22-0f26-4ed8-92f9-314f0c75da9f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.150555 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.151263 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.151546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.151823 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.152608 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:00:54.152926 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.154990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.185645 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.195861 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e41b50-db27-4a81-81c7-e6ebe24f2c9b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.197409 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1381/2761] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:00:54.202792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.203864 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.205568 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.206373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.208135 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.214045 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.254931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1381/2762] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:00:54 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:00:54.255346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.272337 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b09ab-61ed-492b-a2d2-cc8e19d2b946 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.374422 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:54.384878 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.386611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.387126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.387594 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.388566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.391331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.419094 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1382/2763] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:00:54 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:00:54.422817 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.435745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618f0a6-efbc-439e-8afa-dac26a92661c admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.444227 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.445057 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.445452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.445849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.446969 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.450604 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.470214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1382/2764] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:00:54.471132 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.484783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d8ef1-30d1-4426-bef1-b872a0fb6441 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.504379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b4ddb-94c3-4c1d-8e38-f04ccd53a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.505330 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b4ddb-94c3-4c1d-8e38-f04ccd53a263 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.506123 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b4ddb-94c3-4c1d-8e38-f04ccd53a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.506429 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b4ddb-94c3-4c1d-8e38-f04ccd53a263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.507173 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b4ddb-94c3-4c1d-8e38-f04ccd53a263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.509569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b4ddb-94c3-4c1d-8e38-f04ccd53a263 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.525218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1383/2765] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:00:54.526638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.537074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7892d0-0b0f-4a62-a500-62d5106ddd2f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.542494 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.543385 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.543664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.543951 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] PATH_INFO: `/v3/projects/909ddf204a7d438f96aa1d74c8d3b321/users/28ac1b2a69e8496b86a7e6839979d67a/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.568407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909ddf204a7d438f96aa1d74c8d3b321, user_id=28ac1b2a69e8496b86a7e6839979d67a, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.572261 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.600517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1383/2766] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:00:54 2022] PUT /identity/v3/projects/909ddf204a7d438f96aa1d74c8d3b321/users/28ac1b2a69e8496b86a7e6839979d67a/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:54.609139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23bbd1-7c20-4f63-a683-597482562e0d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.609463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23bbd1-7c20-4f63-a683-597482562e0d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.609741 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23bbd1-7c20-4f63-a683-597482562e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.647249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ea23bbd1-7c20-4f63-a683-597482562e0d None None] MFA Rules not processed for user `28ac1b2a69e8496b86a7e6839979d67a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:54.649022 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ea23bbd1-7c20-4f63-a683-597482562e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:54.748438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1384/2767] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:54.757167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:54.758886 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:54.784463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:54.846069 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db787bf2-fc67-45e4-a8fd-58a8089210b8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:54.850894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:54.851549 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:54.851835 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:54.852312 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:54.865697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:54.867538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:54.889305 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1384/2768] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:55.111386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed272c-b1fe-4c9b-ae1c-09a8bacb6566 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:55.111918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed272c-b1fe-4c9b-ae1c-09a8bacb6566 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:55.112013 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed272c-b1fe-4c9b-ae1c-09a8bacb6566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:55.144605 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-18ed272c-b1fe-4c9b-ae1c-09a8bacb6566 None None] MFA Rules not processed for user `ae0a438314e141679ec3efaf69983292`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:55.145886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-18ed272c-b1fe-4c9b-ae1c-09a8bacb6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:55.243296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1385/2769] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:55.257229 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:55.263616 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:55.349674 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec55c-b683-46dc-b5ee-2fc444b81f94 service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:55.356169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:55.356929 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:55.357285 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:55.357638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:55.359554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:55.422690 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:55.424345 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:55.434936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1385/2770] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:56.587070 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a669e-f67b-46cb-b258-11ee505b833d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:56.587614 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a669e-f67b-46cb-b258-11ee505b833d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:56.587768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a669e-f67b-46cb-b258-11ee505b833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:56.606656 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bc1a669e-f67b-46cb-b258-11ee505b833d None None] MFA Rules not processed for user `44618be9281349929e7fd6904e15495a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:56.607813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bc1a669e-f67b-46cb-b258-11ee505b833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:56.615059 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1386/2771] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:00:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:01:05.187082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:05.262626 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b0c66-7938-43a0-88bb-4bcd92eb2899 service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:05.268907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:05.270010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:05.270406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:05.270933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] PATH_INFO: `/v3/users/28ac1b2a69e8496b86a7e6839979d67a` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:05.272170 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ac1b2a69e8496b86a7e6839979d67a)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:05.274100 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:05.275632 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=100 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:05.326672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ac1b2a69e8496b86a7e6839979d67a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.327324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ac1b2a69e8496b86a7e6839979d67a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.340009 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ac1b2a69e8496b86a7e6839979d67a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.346850 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ac1b2a69e8496b86a7e6839979d67a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.356458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ac1b2a69e8496b86a7e6839979d67a'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.363743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1386/2772] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:01:05 2022] DELETE /identity/v3/users/28ac1b2a69e8496b86a7e6839979d67a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:01:05.368677 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:05.369235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:05.369235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:05.387870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:01:05.389115 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:05.431410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:05.452186 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1387/2773] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:01:05.462968 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:05.464475 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:05.523481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c435d-9129-4f7b-84b0-d0bae02bb45d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:05.527993 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bdca1-55cf-4558-9682-61abf2d829f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:05.528693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdca1-55cf-4558-9682-61abf2d829f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:05.528976 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdca1-55cf-4558-9682-61abf2d829f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:05.529254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bdca1-55cf-4558-9682-61abf2d829f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:05.538641 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bdca1-55cf-4558-9682-61abf2d829f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:05.540161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bdca1-55cf-4558-9682-61abf2d829f8 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:05.550422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1387/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:05.831138 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:05.835493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:05.845349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213394-b677-4335-836f-548ee4ca1302 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:05.850011 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:05.850950 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:05.851298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:05.851645 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] PATH_INFO: `/v3/projects/909ddf204a7d438f96aa1d74c8d3b321` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:05.853466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909ddf204a7d438f96aa1d74c8d3b321)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:05.855379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:05.909375 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909ddf204a7d438f96aa1d74c8d3b321', 'request_id': 'req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.915566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909ddf204a7d438f96aa1d74c8d3b321', 'request_id': 'req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.923611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909ddf204a7d438f96aa1d74c8d3b321', 'request_id': 'req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.935952 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] The token cache is being invalidate because project 909ddf204a7d438f96aa1d74c8d3b321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:01:05.936273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.936925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:05.938483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1388/2775] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:01:05 2022] DELETE /identity/v3/projects/909ddf204a7d438f96aa1d74c8d3b321 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:01:15.546077 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:15.932252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:20.593746 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:20.594281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:20.594281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:20.621200 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] MFA Rules not processed for user `5b5507af272a4a71919508d780d17bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:01:20.622399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:20.691672 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1388/2776] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:01:20.997425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:20.998871 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:21.071858 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145a8a-f1ed-481e-8502-88bb1f0a2b13 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:21.075400 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:21.076032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:21.076346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:21.076619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:21.078345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:21.087512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:21.088953 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:21.096740 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1389/2777] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:24.680458 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:24.682772 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:24.703275 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd9c8-795c-4869-ac6f-ed06c4cebfce None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:24.708174 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:24.708894 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:24.709176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:24.709513 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:24.711425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:24.793992 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:24.795524 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:24.806286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1389/2778] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:26.721079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:26.722532 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:26.843003 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229abe-156e-4d72-b24c-3c676bd6e381 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:26.848788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:26.849541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:26.849924 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:26.850298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:26.852759 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:26.866690 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:26.869597 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:26.881491 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1390/2779] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:34.801098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=70 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:36.876822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=81 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:23.420614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:23.422062 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:23.521502 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db88b35-c924-400e-823f-75b140fb0e16 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:23.527401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:23.528079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:23.528366 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:23.528640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:23.531152 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:23.543688 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:23.545252 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:23.555694 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1390/2780] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:32.277112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:32.289287 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba372cf4-c767-40d9-a97b-82e93aaaf77e service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:32.296112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:32.296887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:32.297486 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:32.297847 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:32.299967 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:32.314376 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:32.316911 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:32.332230 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:32.333803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:32.349925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1391/2781] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:32.443798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a5692-4a03-443d-8017-a265b114f5b2 service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:32.449025 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:32.450121 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:32.450400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:32.450676 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] PATH_INFO: `/v3/users/5b5507af272a4a71919508d780d17bfe` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:32.452476 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5507af272a4a71919508d780d17bfe)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:32.454435 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:32.504905 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:32.508326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5507af272a4a71919508d780d17bfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.509362 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5507af272a4a71919508d780d17bfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.522314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5507af272a4a71919508d780d17bfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.529860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5507af272a4a71919508d780d17bfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.537023 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8cf7239b-0aa9-4ace-822a-ed3cf434d654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5507af272a4a71919508d780d17bfe'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.542920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1391/2782] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:32 2022] DELETE /identity/v3/users/5b5507af272a4a71919508d780d17bfe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:32.715329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:32.727401 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1156bf2-f30c-4c11-a74d-880d1469608e service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:32.786157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:32.787016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:32.787298 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:32.787575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] PATH_INFO: `/v3/projects/4310043e6bae4b858c5e849ee33764a1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:32.788790 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4310043e6bae4b858c5e849ee33764a1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:32.790686 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:32.837488 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4310043e6bae4b858c5e849ee33764a1', 'request_id': 'req-079ff26d-2581-4172-b523-9da60b1ba12e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.842881 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4310043e6bae4b858c5e849ee33764a1', 'request_id': 'req-079ff26d-2581-4172-b523-9da60b1ba12e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.850107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4310043e6bae4b858c5e849ee33764a1', 'request_id': 'req-079ff26d-2581-4172-b523-9da60b1ba12e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.861211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] The token cache is being invalidate because project 4310043e6bae4b858c5e849ee33764a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:32.861547 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.862207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-079ff26d-2581-4172-b523-9da60b1ba12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:32.863975 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1392/2783] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:32 2022] DELETE /identity/v3/projects/4310043e6bae4b858c5e849ee33764a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:32.868903 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:32.869212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:32.869490 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:32.924893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:32.926086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:32.983914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1392/2784] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:32.992212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:32.992575 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:32.992851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.011211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:33.012430 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:33.020862 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1393/2785] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:33.024858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.034675 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba0f9a-77b2-408f-804c-6eabf7adb0f8 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.039274 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.039922 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.040238 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.040517 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.041277 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:33.041581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.043169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.054664 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1393/2786] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:33.058723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.068457 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df7b70-ff11-4ff1-894b-f54a6b83e128 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.073415 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.074055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.074341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.074618 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.075308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.077839 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.104082 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1394/2787] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:33 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:02:33.106486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.116349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7caa97-3876-4352-8da2-575652f777f1 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.171465 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.172154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.172438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.172715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.173406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.175363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.194795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1394/2788] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:33 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:33.198987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.209492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3d65-0582-467f-be0a-8eb6d9720d3e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.214006 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.214651 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.214932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.215226 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.215919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.218133 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.228252 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1395/2789] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:33.231868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.241722 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a922e-4643-416b-b426-2f4cfdbeb039 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.246430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b78e0-f35b-45f9-834b-8f106f9519f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.247078 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b78e0-f35b-45f9-834b-8f106f9519f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.247361 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b78e0-f35b-45f9-834b-8f106f9519f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.247639 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b78e0-f35b-45f9-834b-8f106f9519f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.248410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b78e0-f35b-45f9-834b-8f106f9519f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.249994 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b78e0-f35b-45f9-834b-8f106f9519f5 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.251236 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:33.262719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1395/2790] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:33.267327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.277107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469d25-337c-4f5e-b4ac-6bad2008f350 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.282327 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.283221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.283560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.283837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] PATH_INFO: `/v3/projects/763f5473a1b34223882675b8517b5768/users/f0bb1750890a4b66b5695b7e80718d61/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.298091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=763f5473a1b34223882675b8517b5768, user_id=f0bb1750890a4b66b5695b7e80718d61, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.300767 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.313329 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1396/2791] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:33 2022] PUT /identity/v3/projects/763f5473a1b34223882675b8517b5768/users/f0bb1750890a4b66b5695b7e80718d61/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:33.323386 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.323682 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.323964 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.350747 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] MFA Rules not processed for user `f0bb1750890a4b66b5695b7e80718d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:33.352016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:33.415145 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1396/2792] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:33.426660 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.428309 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:33.442394 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:33.503846 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39268e34-5a37-42a2-b36a-0d3daaa9a20a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.509453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc293f9-8fcb-4505-b486-7b9f2b348269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.510100 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc293f9-8fcb-4505-b486-7b9f2b348269 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.510387 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc293f9-8fcb-4505-b486-7b9f2b348269 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.510669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc293f9-8fcb-4505-b486-7b9f2b348269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.519160 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc293f9-8fcb-4505-b486-7b9f2b348269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.520772 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc293f9-8fcb-4505-b486-7b9f2b348269 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.530475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1397/2793] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:33.744036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.806564 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b77b-0f1e-4771-acf6-d90c6fde7346 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:33.811930 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:33.812830 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.813113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.813391 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] PATH_INFO: `/v3/users/f0bb1750890a4b66b5695b7e80718d61` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.814565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bb1750890a4b66b5695b7e80718d61)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:33.816523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:33.862363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bb1750890a4b66b5695b7e80718d61'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:33.863016 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bb1750890a4b66b5695b7e80718d61'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:33.876324 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bb1750890a4b66b5695b7e80718d61'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:33.883619 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bb1750890a4b66b5695b7e80718d61'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:33.891770 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bb1750890a4b66b5695b7e80718d61'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:33.897726 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1397/2794] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:33 2022] DELETE /identity/v3/users/f0bb1750890a4b66b5695b7e80718d61 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:33.902285 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:33.902600 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:33.902880 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:33.919379 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:33.921109 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:33.979034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1398/2795] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:33.989181 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:33.990570 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:33.995400 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:34.070810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb3ce-b673-4390-b72a-974f28e604e8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.074798 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc1850-8961-4604-acfa-847abaaa8b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.075442 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc1850-8961-4604-acfa-847abaaa8b63 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.075752 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc1850-8961-4604-acfa-847abaaa8b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.076036 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc1850-8961-4604-acfa-847abaaa8b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.085118 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc1850-8961-4604-acfa-847abaaa8b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.086581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc1850-8961-4604-acfa-847abaaa8b63 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.096050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1398/2796] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:34.368079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.369546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:34.382416 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f732c-03b4-40d7-ac3b-9d9a3cc7b826 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.387187 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.388083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.388874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.389188 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] PATH_INFO: `/v3/projects/763f5473a1b34223882675b8517b5768` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.390573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=763f5473a1b34223882675b8517b5768)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.392536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.439897 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763f5473a1b34223882675b8517b5768', 'request_id': 'req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:34.446510 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763f5473a1b34223882675b8517b5768', 'request_id': 'req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:34.454241 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763f5473a1b34223882675b8517b5768', 'request_id': 'req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:34.465508 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] The token cache is being invalidate because project 763f5473a1b34223882675b8517b5768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:34.465800 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:34.466453 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f1de02f-20b5-4b6c-97d0-9ee9aed3ce4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:34.467973 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1399/2797] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:34 2022] DELETE /identity/v3/projects/763f5473a1b34223882675b8517b5768 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:34.473015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.473501 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.473615 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.491141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:34.492308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:34.549863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1399/2798] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:34.557768 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.558086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.558360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.577427 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:34.578607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:34.586355 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1400/2799] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:34.590415 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.599824 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7820bc8-a64a-4870-8dc8-1e0ef9fec39b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.604359 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.605002 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.605281 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.605558 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.606276 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:34.606581 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.608259 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.619371 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1400/2800] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:34.623788 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.632969 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8657-71b8-4100-b6bc-dc77ff813e43 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.637567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.638787 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.639086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.639399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.640139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.642025 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.655353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:34.669323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1401/2801] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:34 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:34.673376 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.683161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f7438-cb92-4f9a-a50d-087260a75d7d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.739437 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.740134 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.740451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.740733 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.741597 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.744451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.766251 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1401/2802] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:34 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:34.770485 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.781267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9133d-c460-4347-ad11-c62959868cc1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.785944 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.786632 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.786985 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.787270 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.788019 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.789639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.800968 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1402/2803] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:34.804874 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.811720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:34.815642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3269e-6b6c-4899-afbd-a8241a1b1f0a admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.822283 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f24c54-1467-42d6-978c-de2ff118f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.822985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24c54-1467-42d6-978c-de2ff118f412 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.823254 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24c54-1467-42d6-978c-de2ff118f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.823534 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24c54-1467-42d6-978c-de2ff118f412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.824290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f24c54-1467-42d6-978c-de2ff118f412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.826710 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f24c54-1467-42d6-978c-de2ff118f412 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.836693 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1402/2804] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:34.840906 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:34.851425 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84e1e4-c92b-4fb2-82c0-9dcc360895a9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:34.856165 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:34.857029 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.857313 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.857591 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] PATH_INFO: `/v3/projects/5855a9d226d04227a9af574fc1f0118b/users/662d328da9fa45b4bfc8a14ad07bd9bf/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.872369 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5855a9d226d04227a9af574fc1f0118b, user_id=662d328da9fa45b4bfc8a14ad07bd9bf, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:34.875015 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:34.889305 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1403/2805] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:34 2022] PUT /identity/v3/projects/5855a9d226d04227a9af574fc1f0118b/users/662d328da9fa45b4bfc8a14ad07bd9bf/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:34.900731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:34.901015 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:34.901288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:34.927631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] MFA Rules not processed for user `662d328da9fa45b4bfc8a14ad07bd9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:34.928879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:34.992630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1403/2806] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:34.996970 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.063135 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305dd2-4548-457c-838e-48a5e1f64a52 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.069710 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.070670 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.071088 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.071770 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.072894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.076621 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.107661 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1404/2807] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:34 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:35.110529 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.121095 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c39f1-0599-42e4-8739-00188cff5f6b None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.176717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.177383 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.177671 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.177950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.178638 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.180612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.199786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1404/2808] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:35 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:02:35.203640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.214061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f297f20-c953-4608-ba0f-7d6b7731b851 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.219219 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.219891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.220196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.220475 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.221196 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.222773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.233783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1405/2809] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:35.237730 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.247578 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ddc51-71c4-4cd2-97f0-302392022615 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.251979 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.252878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.253156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.253430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] PATH_INFO: `/v3/projects/65c9364847fc4b3290ea080235f334f7/users/3208666042c449db9f4c6b48fd488ed5/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.267670 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c9364847fc4b3290ea080235f334f7, user_id=3208666042c449db9f4c6b48fd488ed5, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.270401 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.283947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1405/2810] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:35 2022] PUT /identity/v3/projects/65c9364847fc4b3290ea080235f334f7/users/3208666042c449db9f4c6b48fd488ed5/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:35.287939 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.298513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cc3e4-e33c-4202-ab8b-533435ee8bab admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.353980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d943-e347-4de5-a553-99051ec17cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.354639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d943-e347-4de5-a553-99051ec17cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.354923 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d943-e347-4de5-a553-99051ec17cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.355201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d943-e347-4de5-a553-99051ec17cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.355917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d943-e347-4de5-a553-99051ec17cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.357567 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d943-e347-4de5-a553-99051ec17cb5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.367144 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1406/2811] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:35.371419 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.382156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1632-4c3c-44ac-8c4b-16ae9f9cee9d admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.386745 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.387621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.387919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.388875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] PATH_INFO: `/v3/projects/65c9364847fc4b3290ea080235f334f7/users/3208666042c449db9f4c6b48fd488ed5/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.390869 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c9364847fc4b3290ea080235f334f7, user_id=3208666042c449db9f4c6b48fd488ed5, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.393544 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.404368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1406/2812] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:35 2022] PUT /identity/v3/projects/65c9364847fc4b3290ea080235f334f7/users/3208666042c449db9f4c6b48fd488ed5/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:35.414441 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.414949 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.415153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.442851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] MFA Rules not processed for user `3208666042c449db9f4c6b48fd488ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:35.444119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:35.460919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:35.513024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1407/2813] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:35.524592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.526318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:35.567124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:35.606761 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20e47-8691-49bf-a2d7-03327b409383 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.611079 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.611715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.612000 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.612308 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.621284 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.623293 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.632646 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1407/2814] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:35.701399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:35.710992 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92082305-38e3-4bc3-91c8-c0e79b52c305 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:35.714640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba01c-589d-4e95-9c92-284457d3ec85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:35.715354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba01c-589d-4e95-9c92-284457d3ec85 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:35.715639 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba01c-589d-4e95-9c92-284457d3ec85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:35.715917 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba01c-589d-4e95-9c92-284457d3ec85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:35.773147 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ba01c-589d-4e95-9c92-284457d3ec85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:35.774742 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ba01c-589d-4e95-9c92-284457d3ec85 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:35.784303 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1408/2815] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:35.973920 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:36.033912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3122930-477d-4c3c-86f5-73c463c99baf service cinder] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:36.038353 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:36.039208 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:36.039491 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:36.039766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] PATH_INFO: `/v3/users/662d328da9fa45b4bfc8a14ad07bd9bf` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:36.040980 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=662d328da9fa45b4bfc8a14ad07bd9bf)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:36.042877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:36.087098 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662d328da9fa45b4bfc8a14ad07bd9bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.087739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662d328da9fa45b4bfc8a14ad07bd9bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.099916 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662d328da9fa45b4bfc8a14ad07bd9bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.106662 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662d328da9fa45b4bfc8a14ad07bd9bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.114652 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662d328da9fa45b4bfc8a14ad07bd9bf'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.120602 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1408/2816] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:35 2022] DELETE /identity/v3/users/662d328da9fa45b4bfc8a14ad07bd9bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:36.125291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:36.125583 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:36.125912 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:36.143299 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:36.144538 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:36.204526 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1409/2817] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:36.213923 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:36.215331 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:36.258037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:36.275107 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18be92-e706-4492-aeda-c7848243f78f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:36.278786 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:36.279430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:36.279713 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:36.279990 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:36.289193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:36.290569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:36.300540 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1409/2818] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:36.567438 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:36.568972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:36.583721 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b14ca-265c-4e83-a81c-616823ff9e01 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:36.588492 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:36.589384 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:36.589750 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:36.589979 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] PATH_INFO: `/v3/projects/5855a9d226d04227a9af574fc1f0118b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:36.591156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5855a9d226d04227a9af574fc1f0118b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:36.593180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:36.637214 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:36.639143 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5855a9d226d04227a9af574fc1f0118b', 'request_id': 'req-3d354040-3892-4df8-aa4c-cfc2057435bb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.645541 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5855a9d226d04227a9af574fc1f0118b', 'request_id': 'req-3d354040-3892-4df8-aa4c-cfc2057435bb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.652452 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5855a9d226d04227a9af574fc1f0118b', 'request_id': 'req-3d354040-3892-4df8-aa4c-cfc2057435bb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.663221 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] The token cache is being invalidate because project 5855a9d226d04227a9af574fc1f0118b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:36.663516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.664323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.666213 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1410/2819] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:36 2022] DELETE /identity/v3/projects/5855a9d226d04227a9af574fc1f0118b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:36.670299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:36.680086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d3a9-e8dc-41d4-a488-945a91cc2500 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:36.734721 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:36.735580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:36.735860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:36.736161 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] PATH_INFO: `/v3/users/3208666042c449db9f4c6b48fd488ed5` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:36.737357 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3208666042c449db9f4c6b48fd488ed5)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:36.739368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:36.792164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3208666042c449db9f4c6b48fd488ed5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.792842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3208666042c449db9f4c6b48fd488ed5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.805328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3208666042c449db9f4c6b48fd488ed5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.813169 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3208666042c449db9f4c6b48fd488ed5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.820785 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-3c8019e3-9e64-4baa-9b31-3d7ca3ae5271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3208666042c449db9f4c6b48fd488ed5'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:36.827982 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1410/2820] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:36 2022] DELETE /identity/v3/users/3208666042c449db9f4c6b48fd488ed5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:37.104174 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.105693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:37.119769 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d354040-3892-4df8-aa4c-cfc2057435bb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.178941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.179806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.180111 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.180392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] PATH_INFO: `/v3/projects/65c9364847fc4b3290ea080235f334f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.181553 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c9364847fc4b3290ea080235f334f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.183435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.230126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c9364847fc4b3290ea080235f334f7', 'request_id': 'req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:37.235697 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c9364847fc4b3290ea080235f334f7', 'request_id': 'req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:37.243606 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c9364847fc4b3290ea080235f334f7', 'request_id': 'req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:37.254818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] The token cache is being invalidate because project 65c9364847fc4b3290ea080235f334f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:37.255131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:37.255818 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d582bdd7-ec55-4465-a2cb-0cf5e0b5dc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:37.257724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1411/2821] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:37 2022] DELETE /identity/v3/projects/65c9364847fc4b3290ea080235f334f7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:37.262589 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.262876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.263640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.282888 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:37.284086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:37.335425 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:37.345486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1411/2822] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:37.353380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.353590 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.353874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.372175 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:37.373895 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:37.382126 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1412/2823] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:37.386314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.396704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f45ce-9b25-4de7-9263-8f18350f5433 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.401346 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.402004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.402288 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.402569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.403322 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:37.403663 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.405327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.417715 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1412/2824] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:37.422056 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.432577 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2face2-4705-48a4-9e09-f97ed547ddc9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.437774 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.438463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.438754 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.439039 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.439737 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.441663 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.469198 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1413/2825] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:37.473373 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.483314 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6b8a6-0c5d-4230-9948-44f1b70d4807 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.537907 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.538599 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.538887 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.539167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.539858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.541818 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.561999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1413/2826] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:37.566435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.577435 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94548f10-6180-4482-8248-65e1c7d49b8d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.581955 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.582603 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.582887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.583161 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.583882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.585483 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.595586 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1414/2827] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:37.599304 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.609256 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668835cd-708d-4bec-958d-756fcc8e8950 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.613858 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90245d-1d65-47b2-bcb3-db5e6f2ed2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.614505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90245d-1d65-47b2-bcb3-db5e6f2ed2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.614790 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90245d-1d65-47b2-bcb3-db5e6f2ed2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.615068 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90245d-1d65-47b2-bcb3-db5e6f2ed2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.615797 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90245d-1d65-47b2-bcb3-db5e6f2ed2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.617417 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90245d-1d65-47b2-bcb3-db5e6f2ed2ca admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.627794 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1414/2828] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:37.631669 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.642030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35275-13bb-4ef0-8c04-0336279bb99d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.646529 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.647391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.647668 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.647941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] PATH_INFO: `/v3/projects/b533441e25ec40e2b18217ae3435c0bc/users/2c47342c086144e4b6bdf0ec0cbbb130/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.662004 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b533441e25ec40e2b18217ae3435c0bc, user_id=2c47342c086144e4b6bdf0ec0cbbb130, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.664679 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.677596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1415/2829] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:37 2022] PUT /identity/v3/projects/b533441e25ec40e2b18217ae3435c0bc/users/2c47342c086144e4b6bdf0ec0cbbb130/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:37.689509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.690004 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.690131 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.716292 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] MFA Rules not processed for user `2c47342c086144e4b6bdf0ec0cbbb130`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:37.717506 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:37.781395 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1415/2830] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:37.785877 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.790557 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:37.851024 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fc435-a554-47d0-8d95-e2aa3ff3c968 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.855642 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.856319 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.856604 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.857372 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.858065 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.860012 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.885280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1416/2831] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:37.889201 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.899878 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbb136-06c5-4e23-bfc3-414e54e5299e None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.949132 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:37.956975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:37.957642 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:37.957954 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:37.958234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] PATH_INFO: `/v3/users` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:37.958933 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:37.960891 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:37.979902 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1416/2832] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:37 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:37.984341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:37.994472 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe10af-1aca-4155-8162-ee73c5e84d0a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:37.999643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.000332 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.000625 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.000893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.001615 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.003192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.013493 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1417/2833] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:38.017272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:38.027010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1d3a-8844-489f-8dd7-a1b67e5bc40b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:38.033154 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.034124 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.034439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.034826 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] PATH_INFO: `/v3/projects/38721b301c8b4a62977baf37417c2253/users/a262b096e4fd482097632870e4414587/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.050925 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38721b301c8b4a62977baf37417c2253, user_id=a262b096e4fd482097632870e4414587, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.053618 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.066021 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1417/2834] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:38 2022] PUT /identity/v3/projects/38721b301c8b4a62977baf37417c2253/users/a262b096e4fd482097632870e4414587/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:38.069928 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:38.080230 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcdce4-638c-408f-a67c-c03473dd1593 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:38.135223 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d8efb-2ef8-435b-ab3b-2e043aa1be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.135810 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d8efb-2ef8-435b-ab3b-2e043aa1be2b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.136191 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d8efb-2ef8-435b-ab3b-2e043aa1be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.136468 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d8efb-2ef8-435b-ab3b-2e043aa1be2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.137180 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d8efb-2ef8-435b-ab3b-2e043aa1be2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.138752 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d8efb-2ef8-435b-ab3b-2e043aa1be2b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.148331 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1418/2835] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:38.152430 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:38.163011 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb948-a809-445c-8848-5562861a3a5f admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:38.167720 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.168633 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.168915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.169192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] PATH_INFO: `/v3/projects/38721b301c8b4a62977baf37417c2253/users/a262b096e4fd482097632870e4414587/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.171812 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38721b301c8b4a62977baf37417c2253, user_id=a262b096e4fd482097632870e4414587, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.174492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.184627 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1418/2836] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:38 2022] PUT /identity/v3/projects/38721b301c8b4a62977baf37417c2253/users/a262b096e4fd482097632870e4414587/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:38.194386 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0475359-2dae-416c-af78-579393e2f020 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.194680 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0475359-2dae-416c-af78-579393e2f020 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.194962 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0475359-2dae-416c-af78-579393e2f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.221546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b0475359-2dae-416c-af78-579393e2f020 None None] MFA Rules not processed for user `a262b096e4fd482097632870e4414587`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:38.222758 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b0475359-2dae-416c-af78-579393e2f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:38.284688 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:38.290860 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1419/2837] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:38.302582 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:38.304321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:38.360749 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c72d9-b7b5-417d-9209-ecf2b7ad3161 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:38.364363 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd02d6-328e-4c90-a26d-166ae20f8585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.364988 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd02d6-328e-4c90-a26d-166ae20f8585 service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.365272 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd02d6-328e-4c90-a26d-166ae20f8585 service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.365542 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd02d6-328e-4c90-a26d-166ae20f8585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.374318 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd02d6-328e-4c90-a26d-166ae20f8585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.375728 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd02d6-328e-4c90-a26d-166ae20f8585 service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.384875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1419/2838] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:38.449984 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0475359-2dae-416c-af78-579393e2f020 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:38.512108 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0475359-2dae-416c-af78-579393e2f020 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:38.517151 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.518010 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.518291 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.518572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] PATH_INFO: `/v3/users/2c47342c086144e4b6bdf0ec0cbbb130` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.519761 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c47342c086144e4b6bdf0ec0cbbb130)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.521718 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.566268 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c47342c086144e4b6bdf0ec0cbbb130'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:38.566927 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c47342c086144e4b6bdf0ec0cbbb130'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:38.579405 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c47342c086144e4b6bdf0ec0cbbb130'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:38.586090 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c47342c086144e4b6bdf0ec0cbbb130'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:38.593234 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c47342c086144e4b6bdf0ec0cbbb130'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:38.599112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1420/2839] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:38 2022] DELETE /identity/v3/users/2c47342c086144e4b6bdf0ec0cbbb130 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:38.603603 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.603909 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.604192 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.621451 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:38.623219 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:38.678313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1420/2840] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:38.688410 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:38.689816 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:38.748338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ae34e-14dc-4258-9375-3c96b7ee72c8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:38.752103 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:38.752780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:38.753062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:38.753341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:38.762462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:38.763890 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:38.778360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1421/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:39.048436 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:39.049893 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:39.062064 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc59388-169a-4f06-9c50-4ea385101bc4 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:39.066841 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:39.067782 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.068176 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.068541 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] PATH_INFO: `/v3/projects/b533441e25ec40e2b18217ae3435c0bc` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.070013 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b533441e25ec40e2b18217ae3435c0bc)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:39.072260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:39.117704 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:39.120960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b533441e25ec40e2b18217ae3435c0bc', 'request_id': 'req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.128448 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b533441e25ec40e2b18217ae3435c0bc', 'request_id': 'req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.135489 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b533441e25ec40e2b18217ae3435c0bc', 'request_id': 'req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.145975 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] The token cache is being invalidate because project b533441e25ec40e2b18217ae3435c0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:39.146264 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.146921 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.148509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1421/2842] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:39 2022] DELETE /identity/v3/projects/b533441e25ec40e2b18217ae3435c0bc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:39.152536 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:39.162589 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ccd32-e326-4f04-8eb8-1875d39464b6 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:39.180250 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:39.221723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:39.222611 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.222870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.223146 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] PATH_INFO: `/v3/users/a262b096e4fd482097632870e4414587` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.224345 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a262b096e4fd482097632870e4414587)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:39.226280 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:39.270570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a262b096e4fd482097632870e4414587'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.271211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a262b096e4fd482097632870e4414587'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.283436 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a262b096e4fd482097632870e4414587'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.290163 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a262b096e4fd482097632870e4414587'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.297229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a305ade7-229d-4647-8288-c11ec8056cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a262b096e4fd482097632870e4414587'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.303051 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1422/2843] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:39 2022] DELETE /identity/v3/users/a262b096e4fd482097632870e4414587 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:39.569333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:39.570917 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:39.588837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2502f-1518-40b7-8fca-8e9f3a5eb20b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:39.646241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:39.647167 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.647470 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.647779 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] PATH_INFO: `/v3/projects/38721b301c8b4a62977baf37417c2253` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.649123 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=38721b301c8b4a62977baf37417c2253)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:39.651034 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:39.697360 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38721b301c8b4a62977baf37417c2253', 'request_id': 'req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.703831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38721b301c8b4a62977baf37417c2253', 'request_id': 'req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.711836 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38721b301c8b4a62977baf37417c2253', 'request_id': 'req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.722007 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] The token cache is being invalidate because project 38721b301c8b4a62977baf37417c2253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:39.722290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.722913 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-6c6ae54b-6ebc-43d9-b46d-2faebbafbd4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:39.724459 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1422/2844] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:39 2022] DELETE /identity/v3/projects/38721b301c8b4a62977baf37417c2253 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:39.729349 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.729807 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.730032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.750101 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:39.751324 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:39.809434 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1423/2845] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:39.817640 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.817934 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.818217 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.837128 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:39.838328 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:39.846333 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1423/2846] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:39.850406 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:39.860185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4b043-77ef-4787-8d32-73478b9ab215 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:39.865371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:39.866028 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.866308 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.866958 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.867328 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:39.867636 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:39.869248 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:39.881713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1424/2847] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:39.885926 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:39.895750 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c4e5-1eb3-4e62-a034-f8cb9db6e976 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:39.900446 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:39.901090 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.901374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.901653 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.902340 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:39.904300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:39.929309 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1424/2848] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:39 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:39.933257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:39.943887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070ce90-6c91-4c2c-a4a5-82e4cc3c64e2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:39.967813 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:40.002162 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.002824 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.003107 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.003392 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.004125 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.006099 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.025648 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1425/2849] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:39 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:02:40.030329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.040621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824bc59-ed11-4eb2-8f4b-a1be9c970b30 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.045278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.045931 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.046218 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.046500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.047228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.048860 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.059250 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1425/2850] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:40.062945 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.073272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ecde-dcc0-4b78-a810-c5853c46b01d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.078413 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60311e0c-1538-4814-b933-a8391d0ef2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.079061 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60311e0c-1538-4814-b933-a8391d0ef2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.079346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60311e0c-1538-4814-b933-a8391d0ef2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.079627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60311e0c-1538-4814-b933-a8391d0ef2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.080391 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60311e0c-1538-4814-b933-a8391d0ef2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.081965 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60311e0c-1538-4814-b933-a8391d0ef2cb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.092458 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1426/2851] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:40.096369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.106855 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b33f7-99e0-4fcc-8267-015620bf20e7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.111452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.112349 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.112630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.112908 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] PATH_INFO: `/v3/projects/901a02cf7c074b73a6aaf92f337744e6/users/75d3450f2f2a4dcea313e5b6484f5bc2/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.127081 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901a02cf7c074b73a6aaf92f337744e6, user_id=75d3450f2f2a4dcea313e5b6484f5bc2, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.129766 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.138865 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:40.143844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1426/2852] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:40 2022] PUT /identity/v3/projects/901a02cf7c074b73a6aaf92f337744e6/users/75d3450f2f2a4dcea313e5b6484f5bc2/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:40.204691 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.204988 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.205273 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.232478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] MFA Rules not processed for user `75d3450f2f2a4dcea313e5b6484f5bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:40.233624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:40.296016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1427/2853] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:40.300630 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.361193 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f6c1e-f45e-43ee-aff4-f96791f64a30 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.365837 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.366479 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.366765 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.367050 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.367739 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.369661 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.393499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1427/2854] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:40 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:40.397612 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.408809 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6385f0-a19e-40ad-bc54-26bad372df30 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.463837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.464531 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.464811 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.465086 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.465780 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.468229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.489189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1428/2855] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:40 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:40.492985 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.503380 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f202-36ff-4853-bae2-46517c36c20b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.508017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.508707 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.509017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.509299 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.510027 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.511648 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.522260 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1428/2856] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:40.526389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.536954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c585e-cd0c-47c5-91d9-8fa337cfa7ed admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.541566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.542439 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.542736 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.543038 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] PATH_INFO: `/v3/projects/f74ae823038b4715b8c63187241da43e/users/fb5daed24e614b7882bdf6cd75f8ead5/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.558211 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74ae823038b4715b8c63187241da43e, user_id=fb5daed24e614b7882bdf6cd75f8ead5, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.560914 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.569773 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:40.575411 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1429/2857] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:40 2022] PUT /identity/v3/projects/f74ae823038b4715b8c63187241da43e/users/fb5daed24e614b7882bdf6cd75f8ead5/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:40.579278 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.589172 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219844ed-af99-4cb4-aebd-71500891d108 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.645008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1106cb-52b6-42a3-a28c-7e18f9b49458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.645667 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1106cb-52b6-42a3-a28c-7e18f9b49458 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.645949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1106cb-52b6-42a3-a28c-7e18f9b49458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.646226 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1106cb-52b6-42a3-a28c-7e18f9b49458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.646999 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1106cb-52b6-42a3-a28c-7e18f9b49458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.648620 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1106cb-52b6-42a3-a28c-7e18f9b49458 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.658724 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1429/2858] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:40.662728 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.673500 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3fc8-7c8d-4218-977e-599d7ee523df admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.678052 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.678916 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.679201 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.679479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] PATH_INFO: `/v3/projects/f74ae823038b4715b8c63187241da43e/users/fb5daed24e614b7882bdf6cd75f8ead5/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.681460 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74ae823038b4715b8c63187241da43e, user_id=fb5daed24e614b7882bdf6cd75f8ead5, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.684093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.694360 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1430/2859] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:40 2022] PUT /identity/v3/projects/f74ae823038b4715b8c63187241da43e/users/fb5daed24e614b7882bdf6cd75f8ead5/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:40.704947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.705241 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.705523 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.731286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] MFA Rules not processed for user `fb5daed24e614b7882bdf6cd75f8ead5`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:40.732563 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:40.792656 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:40.803368 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1430/2860] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:40.814560 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:40.816433 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:40.879542 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51960290-1350-4cb7-b130-c81780703010 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:40.883265 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:40.883918 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:40.884246 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:40.884527 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:40.894112 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:40.895563 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:40.905704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1431/2861] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:41.001020 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:41.010759 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c47d5-f4a0-4f0b-a675-f58181e65eb7 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:41.014853 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc51a-5c25-467b-aeee-cdd49cb2e47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:41.015486 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc51a-5c25-467b-aeee-cdd49cb2e47a service cinder] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:41.015768 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc51a-5c25-467b-aeee-cdd49cb2e47a service cinder] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:41.016046 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc51a-5c25-467b-aeee-cdd49cb2e47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:41.073679 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acc51a-5c25-467b-aeee-cdd49cb2e47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:41.075032 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acc51a-5c25-467b-aeee-cdd49cb2e47a service cinder] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:41.084681 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1431/2862] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:43.628524 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:43.689695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027671d-6478-428c-b583-b4e9fe66ed23 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:43.694212 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:43.695064 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:43.695348 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:43.695623 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] PATH_INFO: `/v3/users/75d3450f2f2a4dcea313e5b6484f5bc2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:43.697071 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d3450f2f2a4dcea313e5b6484f5bc2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:43.698999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:43.747762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d3450f2f2a4dcea313e5b6484f5bc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:43.748672 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d3450f2f2a4dcea313e5b6484f5bc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:43.761479 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d3450f2f2a4dcea313e5b6484f5bc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:43.771886 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d3450f2f2a4dcea313e5b6484f5bc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:43.781192 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d3450f2f2a4dcea313e5b6484f5bc2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:43.787224 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1432/2863] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:43 2022] DELETE /identity/v3/users/75d3450f2f2a4dcea313e5b6484f5bc2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:43.791879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:43.792378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:43.792505 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:43.809407 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:43.810525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:43.866554 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1432/2864] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:43.876264 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:43.877704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:43.888643 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:43.936428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f0f9-623a-466c-b355-331c5e09ca55 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:43.940087 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:43.940730 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:43.941014 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:43.941292 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:43.950461 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:43.952704 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:43.962083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1433/2865] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:44.223875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:44.225462 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:44.237593 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff2c8b-fcec-4c3a-9900-b4c486d82db0 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:44.242257 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:44.243120 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:44.243406 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:44.243689 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] PATH_INFO: `/v3/projects/901a02cf7c074b73a6aaf92f337744e6` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:44.244949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=901a02cf7c074b73a6aaf92f337744e6)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:44.246868 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:44.296508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901a02cf7c074b73a6aaf92f337744e6', 'request_id': 'req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.302735 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901a02cf7c074b73a6aaf92f337744e6', 'request_id': 'req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.310026 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901a02cf7c074b73a6aaf92f337744e6', 'request_id': 'req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.320228 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] The token cache is being invalidate because project 901a02cf7c074b73a6aaf92f337744e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:44.320515 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.321390 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.322939 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1433/2866] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:44 2022] DELETE /identity/v3/projects/901a02cf7c074b73a6aaf92f337744e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:44.326972 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:44.336626 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669f62-afc1-4a1c-bbfb-25399b0837b6 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:44.392712 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:44.393506 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:44.393791 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:44.394068 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] PATH_INFO: `/v3/users/fb5daed24e614b7882bdf6cd75f8ead5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:44.395300 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5daed24e614b7882bdf6cd75f8ead5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:44.397267 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:44.442745 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5daed24e614b7882bdf6cd75f8ead5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.443396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5daed24e614b7882bdf6cd75f8ead5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.455837 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5daed24e614b7882bdf6cd75f8ead5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.462655 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5daed24e614b7882bdf6cd75f8ead5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.470366 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d789be89-0d5b-4acc-a8b3-b5d8042c4fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5daed24e614b7882bdf6cd75f8ead5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.477119 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1434/2867] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:44 2022] DELETE /identity/v3/users/fb5daed24e614b7882bdf6cd75f8ead5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:44.743504 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:44.745249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:44.760262 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6ddb-662a-4c33-9dfb-8b6d4699cd5b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:44.777488 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:44.836300 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:44.837631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:44.838091 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:44.838492 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] PATH_INFO: `/v3/projects/f74ae823038b4715b8c63187241da43e` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:44.839896 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74ae823038b4715b8c63187241da43e)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:44.843583 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:44.888562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74ae823038b4715b8c63187241da43e', 'request_id': 'req-5810988b-9573-4139-8f37-4ffca6a09436'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.894815 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74ae823038b4715b8c63187241da43e', 'request_id': 'req-5810988b-9573-4139-8f37-4ffca6a09436'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.902221 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74ae823038b4715b8c63187241da43e', 'request_id': 'req-5810988b-9573-4139-8f37-4ffca6a09436'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.913076 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] The token cache is being invalidate because project f74ae823038b4715b8c63187241da43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:44.913367 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.914006 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-5810988b-9573-4139-8f37-4ffca6a09436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:44.915538 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1434/2868] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:44 2022] DELETE /identity/v3/projects/f74ae823038b4715b8c63187241da43e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:44.921321 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:44.921808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:44.921808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:44.939630 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:44.940869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:44.965804 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:45.000954 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1435/2869] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:45.008719 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.009010 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.009290 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.027101 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:45.028399 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:45.036867 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1435/2870] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:45.040899 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.050959 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534dd7d-b5d4-4660-a0b2-8dc5353fdea6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.055502 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.056185 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.056462 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.056733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.057445 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:45.057748 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.059316 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.070571 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1436/2871] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 14 11:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:45.074960 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.083949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38984-d48d-4a01-b325-e5af68c6c3c2 None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.088607 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.089243 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.089526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.089803 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.090481 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.092918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.119440 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1436/2872] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:45 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:45.123572 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.133980 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe895cc-5665-44b7-82e6-5cdbace95d77 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.191909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.192528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.192812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.193091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.193822 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.195733 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.215389 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1437/2873] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:45 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:45.220039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.230082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7215af-48cf-4ee5-8c85-4ab61352751b admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.234692 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.235338 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.235621 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.235898 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.236657 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.238231 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.248387 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1437/2874] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:45.251989 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.261851 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a76dd1-4ad7-4615-b32b-8dfb8b32adaa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.267062 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91121e-5c72-47da-aeb3-8da2e7affe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.267708 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91121e-5c72-47da-aeb3-8da2e7affe99 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.267990 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91121e-5c72-47da-aeb3-8da2e7affe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.268294 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91121e-5c72-47da-aeb3-8da2e7affe99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.269016 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91121e-5c72-47da-aeb3-8da2e7affe99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.270573 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91121e-5c72-47da-aeb3-8da2e7affe99 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.281001 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1438/2875] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:45.284938 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.294828 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d71aa-1734-4273-a17d-e70e184d82f8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.299482 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.300379 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.300665 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.300936 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] PATH_INFO: `/v3/projects/496cf689fc4e4326a54ca6e859c44e6b/users/bcc1fa7521504ef0a718ea3665bdad62/roles/48fbdd1d59bf4d1482c26dc9539019f7` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.315539 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496cf689fc4e4326a54ca6e859c44e6b, user_id=bcc1fa7521504ef0a718ea3665bdad62, role_id=48fbdd1d59bf4d1482c26dc9539019f7)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.318204 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.331500 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1438/2876] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:45 2022] PUT /identity/v3/projects/496cf689fc4e4326a54ca6e859c44e6b/users/bcc1fa7521504ef0a718ea3665bdad62/roles/48fbdd1d59bf4d1482c26dc9539019f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:45.337874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6305d-63b5-48a6-ba52-33431c9aeb5d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.338168 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6305d-63b5-48a6-ba52-33431c9aeb5d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.338448 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6305d-63b5-48a6-ba52-33431c9aeb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.356516 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-51a6305d-63b5-48a6-ba52-33431c9aeb5d None None] MFA Rules not processed for user `6dda363092bb44769e4fcafaa65574cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:45.357711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-51a6305d-63b5-48a6-ba52-33431c9aeb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:45.415596 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1439/2877] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:45.425017 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:45.426677 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:45.474184 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:45.486148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db86a-ef3c-4f6e-881b-c53eca5f93d8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:45.489904 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:45.490547 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:45.490831 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:45.491113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:45.500565 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:45.501995 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:45.511286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1439/2878] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:46.119566 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.120093 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.120353 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.147032 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] MFA Rules not processed for user `bcc1fa7521504ef0a718ea3665bdad62`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:46.148307 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:46.176909 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:46.219783 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1440/2879] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:46.224303 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.234403 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82023774-07cc-4afa-832e-78a0a8617f72 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.239115 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.239823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.240156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.240439 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.241141 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.243082 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.270423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1440/2880] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:46.274218 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.285637 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d159eb-c120-4ffc-b9b1-6ee1e4f12d0d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.342883 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.343601 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.343887 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.344189 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.344874 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.346779 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.367671 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1441/2881] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:46 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:46.371741 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.382762 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523b35-c972-4f68-bce1-ab9b2b73c9c2 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.387326 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.387974 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.388289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.388569 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.389947 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.391530 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.402119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1441/2882] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:46.406551 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.416242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfb2e6-5f4c-4091-a17c-d1177a858bdc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.421463 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.422333 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.422619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.422891 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] PATH_INFO: `/v3/projects/6d54c6f0eab24a029d98d10f47771e94/users/e1302b88d0074fe3a466c895266e3c66/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.437242 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d54c6f0eab24a029d98d10f47771e94, user_id=e1302b88d0074fe3a466c895266e3c66, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.439856 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.453083 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1442/2883] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:46 2022] PUT /identity/v3/projects/6d54c6f0eab24a029d98d10f47771e94/users/e1302b88d0074fe3a466c895266e3c66/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:46.456935 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.467711 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8401-b3e0-437d-8ba2-e93f9d328fe7 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.534723 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05765-7ae2-4096-8ed2-d84418075a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.535614 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05765-7ae2-4096-8ed2-d84418075a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.536039 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05765-7ae2-4096-8ed2-d84418075a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.536499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05765-7ae2-4096-8ed2-d84418075a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.537438 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded05765-7ae2-4096-8ed2-d84418075a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.539019 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded05765-7ae2-4096-8ed2-d84418075a50 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.551249 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1442/2884] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:46.555607 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.566598 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98d7f6-cc7b-4c05-927f-f7c2926b9174 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.571520 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2dbd-67cd-416f-8b0d-9ae6792e1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.572421 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2dbd-67cd-416f-8b0d-9ae6792e1b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.572702 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2dbd-67cd-416f-8b0d-9ae6792e1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.572978 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2dbd-67cd-416f-8b0d-9ae6792e1b73 admin admin] PATH_INFO: `/v3/projects/6d54c6f0eab24a029d98d10f47771e94/users/e1302b88d0074fe3a466c895266e3c66/roles/195f05d542f14d7b93230878b428d9eb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.575002 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e2dbd-67cd-416f-8b0d-9ae6792e1b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d54c6f0eab24a029d98d10f47771e94, user_id=e1302b88d0074fe3a466c895266e3c66, role_id=195f05d542f14d7b93230878b428d9eb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.578296 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e2dbd-67cd-416f-8b0d-9ae6792e1b73 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.588762 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1443/2885] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:46 2022] PUT /identity/v3/projects/6d54c6f0eab24a029d98d10f47771e94/users/e1302b88d0074fe3a466c895266e3c66/roles/195f05d542f14d7b93230878b428d9eb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:47.183876 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] REQUEST_METHOD: `POST` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.184242 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.184525 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.213374 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.auth.core [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] MFA Rules not processed for user `e1302b88d0074fe3a466c895266e3c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:47.214577 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.284190 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1443/2886] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:47.296231 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.296722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.296852 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.314569 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] MFA Rules not processed for user `bcc1fa7521504ef0a718ea3665bdad62`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:47.315725 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.373195 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1444/2887] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:47.387066 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.388526 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.427780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:47.462143 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb35261-b840-447f-bf41-88cd35518bfe None None] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.468271 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.468915 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.469196 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.469473 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.477148 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.478717 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.487461 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1444/2888] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:57.366399 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.483404 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=18 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.769999 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:57.771408 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:57.828139 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff4e44-bc5f-4134-aa7e-bd34f99de570 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.831695 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7de00325c784e79be24c9928dd535e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.832354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.832640 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.832919 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.842396 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.843817 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.853546 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1445/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:07.849042 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=26 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:16.316629 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.378214 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e949d-e95c-440d-9114-e111afdf98ad service nova] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.382697 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.383561 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.383844 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.384156 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] PATH_INFO: `/v3/users/bcc1fa7521504ef0a718ea3665bdad62` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.385348 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc1fa7521504ef0a718ea3665bdad62)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.387265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.435126 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc1fa7521504ef0a718ea3665bdad62'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.435792 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc1fa7521504ef0a718ea3665bdad62'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.448286 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc1fa7521504ef0a718ea3665bdad62'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.455194 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc1fa7521504ef0a718ea3665bdad62'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.463369 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc1fa7521504ef0a718ea3665bdad62'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.470918 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1445/2890] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:03:16 2022] DELETE /identity/v3/users/bcc1fa7521504ef0a718ea3665bdad62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:16.646932 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.660257 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053baeb5-80e5-4d98-857d-27fbc0c982ce service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.716055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.717140 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.717423 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.717703 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] PATH_INFO: `/v3/projects/496cf689fc4e4326a54ca6e859c44e6b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.719451 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496cf689fc4e4326a54ca6e859c44e6b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.721371 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.766866 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496cf689fc4e4326a54ca6e859c44e6b', 'request_id': 'req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.772266 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496cf689fc4e4326a54ca6e859c44e6b', 'request_id': 'req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.779947 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496cf689fc4e4326a54ca6e859c44e6b', 'request_id': 'req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.791229 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] The token cache is being invalidate because project 496cf689fc4e4326a54ca6e859c44e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:03:16.791513 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.792156 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.793694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1446/2891] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:03:16 2022] DELETE /identity/v3/projects/496cf689fc4e4326a54ca6e859c44e6b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:16.797842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.799253 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:16.812421 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac10eb-bb9e-44a8-8770-cf168389d157 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.867463 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.868447 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.868731 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.869008 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] PATH_INFO: `/v3/users/e1302b88d0074fe3a466c895266e3c66` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.870212 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1302b88d0074fe3a466c895266e3c66)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.872157 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.894206 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:16.919149 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1302b88d0074fe3a466c895266e3c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.919807 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1302b88d0074fe3a466c895266e3c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.931509 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1302b88d0074fe3a466c895266e3c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.938780 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1302b88d0074fe3a466c895266e3c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.945659 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1302b88d0074fe3a466c895266e3c66'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:16.951852 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1446/2892] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:03:16 2022] DELETE /identity/v3/users/e1302b88d0074fe3a466c895266e3c66 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:17.123235 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.124882 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:17.138254 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5612d-f10f-444e-8b6b-0d10d63d82e1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.193941 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.194797 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.195079 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.195354 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] PATH_INFO: `/v3/projects/6d54c6f0eab24a029d98d10f47771e94` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.196808 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d54c6f0eab24a029d98d10f47771e94)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.198694 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.231894 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.245802 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d54c6f0eab24a029d98d10f47771e94', 'request_id': 'req-55bd2210-fe8a-4d77-a6be-ef371272b4a8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:17.251743 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d54c6f0eab24a029d98d10f47771e94', 'request_id': 'req-55bd2210-fe8a-4d77-a6be-ef371272b4a8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:17.258806 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d54c6f0eab24a029d98d10f47771e94', 'request_id': 'req-55bd2210-fe8a-4d77-a6be-ef371272b4a8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:17.270620 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] The token cache is being invalidate because project 6d54c6f0eab24a029d98d10f47771e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:03:17.270907 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:17.271539 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:03:17.273105 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1447/2893] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:03:17 2022] DELETE /identity/v3/projects/6d54c6f0eab24a029d98d10f47771e94 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:23.594612 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.596086 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:23.650499 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b85dc-049e-44d2-92fe-f01fa78a56e8 admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.697093 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.697756 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.698042 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.698321 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.700164 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:23.770863 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.772265 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.773950 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.786422 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1447/2894] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:24.956722 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:24.958204 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:24.970478 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2210-fe8a-4d77-a6be-ef371272b4a8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:24.974713 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:24.975346 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:24.975628 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:24.975904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.977693 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:24.990931 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.992383 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:25.003517 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1448/2895] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:33.789912 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=2 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.998442 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=18,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:35.779628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:35.781139 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:35.791628 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274840-e726-41f4-97de-5c6359d45fd5 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:35.795177 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:35.795810 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.796113 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.796392 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.798119 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:35.807919 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:35.809372 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:35.818150 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1448/2896] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:35.912893 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:35.921785 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4723-96b0-4e68-a352-c6cf4ad3d7fa service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:35.925987 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:35.926638 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.926925 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.927261 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.929155 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:35.944190 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:35.945659 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:35.957584 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1449/2897] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:45.813877 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:45.952034 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.491329 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.500879 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591429c9-ce7c-41ab-8690-cda9be802436 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.504706 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f86dd9b76ef42e8a6fbff301df7d3b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.505344 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.505631 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.505914 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.507687 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:31.517088 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.518508 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.526423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1449/2898] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:04:41.522823 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=6 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:57.329249 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:57.330687 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:57.348501 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1049f7-8b96-4ed8-8df8-5502753b861f service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:57.357153 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11d05026ac51451a8c10fb63f840d15f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:57.357812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.358091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.358367 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.360272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:57.373627 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:57.375341 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:57.389512 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1450/2899] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:05.305423 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:05.306842 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:05.383635 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716175f2-55e1-408d-b5ad-6a6d6c06bb47 service neutron] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:05.389851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.390510 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] REQUEST_METHOD: `GET` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.390795 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.391074 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.392977 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:05.405160 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.406727 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.417452 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1450/2900] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:07.384157 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.244243 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.246658 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:08.319570 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb7ed-d025-440a-9e9b-8f26d25e31c2 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.325692 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.326619 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.326904 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.327207 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] PATH_INFO: `/v3/users/44618be9281349929e7fd6904e15495a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.328489 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44618be9281349929e7fd6904e15495a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.330428 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.379055 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44618be9281349929e7fd6904e15495a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.379706 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44618be9281349929e7fd6904e15495a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.391380 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44618be9281349929e7fd6904e15495a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.398134 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44618be9281349929e7fd6904e15495a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.405477 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44618be9281349929e7fd6904e15495a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.411338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1451/2901] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:08 2022] DELETE /identity/v3/users/44618be9281349929e7fd6904e15495a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:08.581743 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.594647 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fd03-dc84-4266-aec1-c12482990b5c service placement] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.651972 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.652851 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.653133 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.653410 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] PATH_INFO: `/v3/projects/ae43fe86723249849ae86dcf758a3bda` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.654580 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae43fe86723249849ae86dcf758a3bda)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.656576 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.701220 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae43fe86723249849ae86dcf758a3bda', 'request_id': 'req-a20f1241-e00d-4d78-8527-8146a25c954e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.707289 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae43fe86723249849ae86dcf758a3bda', 'request_id': 'req-a20f1241-e00d-4d78-8527-8146a25c954e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.714592 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae43fe86723249849ae86dcf758a3bda', 'request_id': 'req-a20f1241-e00d-4d78-8527-8146a25c954e'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.725037 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] The token cache is being invalidate because project ae43fe86723249849ae86dcf758a3bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:08.725327 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.725952 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.727566 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1451/2902] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:08 2022] DELETE /identity/v3/projects/ae43fe86723249849ae86dcf758a3bda => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:08.732272 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.733674 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:08.746559 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9b1e-1f89-4613-9c8f-9d920428b2e6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.802870 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.803724 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.804005 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.804323 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] PATH_INFO: `/v3/users/ae0a438314e141679ec3efaf69983292` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.805494 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0a438314e141679ec3efaf69983292)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.807466 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.829350 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.854205 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0a438314e141679ec3efaf69983292'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.854869 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0a438314e141679ec3efaf69983292'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.867365 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0a438314e141679ec3efaf69983292'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.874358 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0a438314e141679ec3efaf69983292'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.882030 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0a438314e141679ec3efaf69983292'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:08.888865 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1452/2903] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:08 2022] DELETE /identity/v3/users/ae0a438314e141679ec3efaf69983292 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:09.058849 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Authenticating user token {{(pid=80167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.060774 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.fernet_utils [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:09.074234 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f1241-e00d-4d78-8527-8146a25c954e admin admin] Validating token access rules against request {{(pid=80167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.092588 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.133587 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dda363092bb44769e4fcafaa65574cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dceb4db085a4305881c3af4908bb6f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.134562 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.134845 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.135125 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] PATH_INFO: `/v3/projects/ea26e9e6ad5a49a6b09e3d42a60baa4f` {{(pid=80167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.137457 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea26e9e6ad5a49a6b09e3d42a60baa4f)` {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:09.139378 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] RBAC: Authorization granted {{(pid=80167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:09.184358 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea26e9e6ad5a49a6b09e3d42a60baa4f', 'request_id': 'req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:09.190313 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea26e9e6ad5a49a6b09e3d42a60baa4f', 'request_id': 'req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:09.197875 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea26e9e6ad5a49a6b09e3d42a60baa4f', 'request_id': 'req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8'} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:09.209495 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] The token cache is being invalidate because project ea26e9e6ad5a49a6b09e3d42a60baa4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:09.209784 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:09.210411 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG keystone.notifications [None req-8f9a647a-f08c-4f43-9aa3-9257c8ffdbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:09.211949 dv-cinder-822821-5-smb devstack@keystone.service[80167]: [pid: 80167|app: 0|req: 1452/2904] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:09 2022] DELETE /identity/v3/projects/ea26e9e6ad5a49a6b09e3d42a60baa4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:18.884624 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:19.206035 dv-cinder-822821-5-smb devstack@keystone.service[80167]: DEBUG dbcounter [-] [80167] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:30.783711 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:30.785131 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:30.853696 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b9d6-9396-4c02-bd71-c4020c767888 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:30.912873 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '005d2ffd11584aaca47ba71a8bc2811a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d44c13b7bf42b1b3576f31a21650fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:30.913528 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:30.913812 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:30.914091 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:30.915875 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:30.927723 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:30.929322 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1ca6b-a639-4030-803c-d1a828d46e07 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:30.939338 dv-cinder-822821-5-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1453/2905] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 14 11:07:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:07:40.934929 dv-cinder-822821-5-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=58 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}